Jul 06 12:01:59 devstack cinder-volume[75474]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 12:01:59 devstack cinder-volume[75474]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:01:59 devstack cinder-volume[75474]: we strongly recommend against using it for new projects. Jul 06 12:01:59 devstack cinder-volume[75474]: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:01:59 devstack cinder-volume[75474]: framework. For more detail see Jul 06 12:01:59 devstack cinder-volume[75474]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:01:59 devstack cinder-volume[75474]: import eventlet # noqa Jul 06 12:02:02 devstack cinder-volume[75474]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:02:02 devstack cinder-volume[75474]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:02:02 devstack cinder-volume[75474]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:02:02 devstack cinder-volume[75474]: INFO dbcounter [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Registered counter for database cinder Jul 06 12:02:03 devstack cinder-volume[75474]: DEBUG oslo_db.sqlalchemy.engines [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75474) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:02:03 devstack cinder-volume[75474]: DEBUG dbcounter [-] [75474] Writer thread running {{(pid=75474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:02:03 devstack cinder-volume[75474]: INFO cinder.rpc [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 12:02:03 devstack cinder-volume[75474]: INFO cinder.rpc [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 12:02:03 devstack cinder-volume[75474]: DEBUG oslo_db.sqlalchemy.engines [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75474) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:02:03 devstack cinder-volume[75474]: INFO cinder.volume.manager [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Determined volume DB was empty at startup. Jul 06 12:02:03 devstack cinder-volume[75474]: DEBUG cinder.volume.manager [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75474) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 12:02:03 devstack cinder-volume[75474]: INFO cinder.volume.manager [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 12:02:03 devstack cinder-volume[75474]: WARNING stevedore.named [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:02:03 devstack cinder-volume[75474]: WARNING castellan.key_manager [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:02:03 devstack cinder-volume[75474]: WARNING cinder.keymgr.conf_key_mgr [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:02:03 devstack cinder-volume[75474]: DEBUG cinder.volume.drivers.lvm [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75474) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 06 12:02:03 devstack cinder-volume[75474]: DEBUG oslo_concurrency.processutils [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_concurrency.processutils [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] CMD "cinder-rtstool verify" returned: 0 in 0.642s {{(pid=75474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_db.sqlalchemy.engines [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75474) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:02:04 devstack cinder-volume[75474]: INFO cinder.rpc [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 06 12:02:04 devstack cinder-volume[75474]: INFO cinder.rpc [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 06 12:02:04 devstack cinder-volume[75474]: WARNING stevedore.named [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:02:04 devstack cinder-volume[75474]: WARNING castellan.key_manager [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:02:04 devstack cinder-volume[75474]: INFO cinder.volume.manager [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_db.sqlalchemy.engines [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75474) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:02:04 devstack cinder-volume[75474]: INFO oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Starting 1 workers Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Started child 75648 {{(pid=75474) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Full set of CONF: {{(pid=75474) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] ******************************************************************************** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Configuration options gathered from: {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] ================================================================================ {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] allow_availability_zone_fallback = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] allow_compression_on_image_upload = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] allowed_direct_url_schemes = [] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] api_rate_limit = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] auth_strategy = keystone {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] az_cache_duration = 3600 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_availability_zone = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_host = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_name = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_stats_polling_interval = 60 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backup_api_class = cinder.backup.api.API {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backup_name_template = backup-%s {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75648]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backup_use_same_host = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backup_use_temp_snapshot = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] chap_password = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] chap_username = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cinder_internal_tenant_project_id = 35e37e29e889410e8e9d780c33e735c4 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cinder_internal_tenant_user_id = 560dfb1324d640de8fb73526bd797ef1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cloned_volume_same_az = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cluster = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] compression_format = gzip {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] compute_api_class = cinder.compute.nova.API {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] config_dir = [] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] config_source = [] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] control_exchange = openstack {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] debug = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] default_availability_zone = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] default_group_type = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] default_volume_type = lvmdriver-1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] disk_geometry = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] driver_client_cert = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] driver_client_cert_key = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] driver_data_namespace = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] driver_ssl_cert_path = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] driver_ssl_cert_verify = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] driver_use_ssl = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] enable_force_upload = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] enable_new_services = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] enable_unsupported_driver = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] enforce_multipath_for_image_xfer = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] filter_function = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance_api_insecure = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance_api_ssl_compression = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance_ca_certificates_file = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance_catalog_info = image:glance:publicURL {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance_certfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance_keyfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance_num_retries = 3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance_request_timeout = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] goodness_function = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] graceful_shutdown_timeout = 5 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] group_api_class = cinder.group.api.API {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] host = devstack {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] image_compress_on_upload = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] image_conversion_address_space_limit = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] image_conversion_cpu_limit = 60 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] image_conversion_disable = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] image_upload_use_cinder_backend = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] image_upload_use_internal_tenant = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] image_volume_cache_enabled = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] image_volume_cache_max_count = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] image_volume_cache_max_size_gb = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] init_host_max_objects_retrieval = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] instance_format = [instance: %(uuid)s] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] iscsi_target_flags = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] iscsi_write_cache = on {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] iser_helper = tgtadm {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] iser_ip_address = 192.168.122.128 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] iser_port = 3260 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] log_color = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] log_config_append = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] log_dir = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] log_file = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] log_options = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] log_rotate_interval = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] log_rotate_interval_type = days {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] log_rotation_type = none {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] max_age = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] max_logfile_count = 30 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] max_logfile_size_mb = 200 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] max_over_subscription_ratio = 20.0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] message_reap_interval = 86400 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75648]: INFO cinder.volume.manager [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 06 12:02:04 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] message_ttl = 2592000 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] migration_create_volume_timeout_secs = 300 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] monkey_patch = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] monkey_patch_modules = [] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] my_ip = 192.168.122.128 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] no_snapshot_gb_quota = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] num_iser_scan_tries = 3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] num_shell_tries = 3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] num_volume_device_scan_tries = 3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] nvmeof_conn_info_version = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] nvmet_ns_id = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] nvmet_port_id = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] osapi_max_limit = 1000 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] osapi_volume_ext_list = [] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] osapi_volume_listen_port = 8776 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] osapi_volume_use_ssl = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] osapi_volume_workers = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] per_volume_size_limit = -1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] periodic_fuzzy_delay = 60 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] periodic_interval = 60 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] public_endpoint = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] publish_errors = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] quota_backup_gigabytes = 1000 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] quota_backups = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] quota_gigabytes = 1000 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] quota_groups = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] quota_snapshots = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] quota_volumes = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] rate_limit_burst = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] rate_limit_except_level = CRITICAL {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] rate_limit_interval = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] reinit_driver_count = 3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] replication_device = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] report_discard_supported = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] report_interval = 120 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] reservation_clean_interval = 86400 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] reservation_expire = 86400 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] reserved_image_namespaces = [] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] reserved_percentage = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] rpc_response_timeout = 120 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] run_external_periodic_tasks = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] scst_target_driver = iscsi {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] scst_target_iqn_name = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] service_down_time = 720 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] shell_completion = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] snapshot_name_template = snapshot-%s {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] snapshot_same_host = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] split_loggers = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] state_path = /opt/stack/data/cinder {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] storage_availability_zone = nova {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] storage_protocol = iSCSI {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] syslog_log_facility = LOG_USER {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] target_helper = lioadm {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] target_ip_address = 192.168.122.128 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] target_port = 3260 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] target_protocol = iscsi {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] target_secondary_ip_addresses = [] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] trace_flags = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] transport_url = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] until_refresh = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] use_chap_auth = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] use_default_quota_class = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] use_journal = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] use_json = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] use_multipath_for_image_xfer = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] use_stderr = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] use_syslog = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] verify_glance_signatures = enabled {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_api_class = cinder.volume.api.API {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_backend_name = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_clear = zero {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_clear_ionice = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_clear_size = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_copy_bps_limit = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_dd_blocksize = 1M {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_name_template = volume-%s {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_service_inithost_offload = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volume_usage_audit_period = month {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] zoning_mode = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:02:04 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_concurrency.disable_process_locking = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.auth_section = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.auth_type = password {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.auth_version = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.cache = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.certfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.include_service_catalog = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.insecure = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.interface = public {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.keyfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_password = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack sudo[75653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 06 12:02:04 devstack sudo[75653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcache_username = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.region_name = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.service_type = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.backend = dogpile.cache.null {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.backend_argument = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.backend_expiration_time = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.config_prefix = cache.oslo {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.debug_cache_backend = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.enable_retry_client = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.enable_socket_keepalive = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.enabled = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.expiration_time = 600 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.hashclient_retry_attempts = 2 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.memcache_dead_retry = 300 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.memcache_pool_maxsize = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.memcache_sasl_enabled = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.password = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.proxies = [] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.redis_db = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.redis_server = localhost:6379 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.retry_attempts = 2 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.retry_delay = 0.0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.socket_keepalive_count = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.socket_keepalive_idle = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.socket_keepalive_interval = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.socket_timeout = 1.0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.tls_allowed_ciphers = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.tls_cafile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.tls_certfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.tls_enabled = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.tls_keyfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cache.username = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] coordination.backend_url = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.asyncio_connection = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.asyncio_slave_connection = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.backend = sqlalchemy {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.connection = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.connection_debug = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.connection_parameters = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.connection_recycle_time = 3600 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.connection_trace = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.db_inc_retry_interval = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.db_max_retries = 20 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.db_max_retry_interval = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.db_retry_interval = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.max_overflow = 50 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.max_pool_size = 5 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.max_retries = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.mysql_wsrep_sync_wait = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.pool_timeout = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.retry_interval = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.slave_connection = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.sqlite_synchronous = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.synchronous_reader = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] database.use_db_reconnect = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler.connection_string = messaging:// {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler.enabled = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler.es_doc_type = notification {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler.es_scroll_size = 10000 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler.es_scroll_time = 2m {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler.filter_error_trace = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler.hmac_keys = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler.sentinel_service_name = mymaster {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler.socket_timeout = 0.1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler.trace_requests = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler.trace_sqlalchemy = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler_jaeger.process_tags = {} {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler_jaeger.service_name_prefix = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] profiler_otlp.service_name_prefix = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_policy.enforce_new_defaults = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_policy.enforce_scope = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_policy.policy_default_rule = default {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_policy.policy_file = policy.yaml {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] privsep_osbrick.group = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] privsep_osbrick.helper_command = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] privsep_osbrick.user = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cinder_sys_admin.group = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cinder_sys_admin.helper_command = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] cinder_sys_admin.user = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] service_user.auth_section = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] service_user.auth_type = password {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] service_user.cafile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] service_user.certfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] service_user.collect_timing = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] service_user.insecure = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] service_user.keyfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] service_user.send_service_user_token = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] service_user.split_loggers = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] service_user.timeout = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance.auth_section = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance.auth_type = password {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance.certfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance.collect_timing = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance.insecure = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance.keyfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance.region_name = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance.split_loggers = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] glance.timeout = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.backend_availability_zone = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.chap_password = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.chap_username = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.disk_geometry = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.driver_client_cert = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.driver_client_cert_key = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.driver_data_namespace = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.driver_use_ssl = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.extra_capabilities = {} {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.filter_function = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.goodness_function = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.iscsi_target_flags = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.iscsi_write_cache = on {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.iser_helper = tgtadm {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.iser_port = 3260 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.lvm_share_target = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.lvm_type = auto {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.num_shell_tries = 3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.replication_device = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.report_discard_supported = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.reserved_percentage = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.target_helper = tgtadm {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.target_port = 3260 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.target_protocol = iscsi {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.trace_flags = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.unique_fqdn_network = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.use_chap_auth = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.volume_backend_name = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.volume_clear = zero {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.volume_clear_ionice = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.volume_clear_size = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_reports.file_event_handler = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_reports.log_dir = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.backend_host = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.chap_password = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.chap_username = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.disk_geometry = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.driver_client_cert = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.extra_capabilities = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.filter_function = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.goodness_function = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.iser_helper = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.iser_ip_address = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.iser_port = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.lvm_share_target = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.lvm_type = auto {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.num_shell_tries = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.replication_device = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.report_discard_supported = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.reserved_percentage = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.scst_target_driver = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.storage_protocol = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.target_helper = lioadm {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.target_ip_address = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.target_port = 3260 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.trace_flags = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.use_chap_auth = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.volume_clear = zero {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.volume_clear_size = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] lvmdriver-1.volumes_dir = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.ssl = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_notifications.driver = [] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_notifications.retry = -1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] key_manager.fixed_key = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.barbican_api_version = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.barbican_endpoint = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.barbican_endpoint_type = public {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.barbican_region_name = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.cafile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.certfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.collect_timing = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.insecure = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.keyfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.number_of_retries = 60 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.retry_delay = 1 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.send_service_user_token = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.split_loggers = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.timeout = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.verify_ssl = True {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican.verify_ssl_path = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican_service_user.auth_section = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican_service_user.auth_type = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican_service_user.cafile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican_service_user.certfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican_service_user.collect_timing = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican_service_user.insecure = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican_service_user.keyfile = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican_service_user.split_loggers = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] barbican_service_user.timeout = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vault.approle_role_id = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vault.approle_secret_id = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vault.kv_mountpoint = secret {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vault.kv_path = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vault.kv_version = 2 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vault.namespace = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vault.root_token_id = **** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vault.ssl_ca_crt_file = None {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vault.timeout = 60.0 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vault.use_ssl = False {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:02:04 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] ******************************************************************************** {{(pid=75474) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 12:02:05 devstack sudo[75653]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:05 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.805s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:05 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:05 devstack sudo[75904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:02:05 devstack sudo[75904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:06 devstack sudo[75904]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:06 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.742s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:06 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:02:06 devstack cinder-volume[75648]: INFO cinder.brick.local_dev.lvm [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 06 12:02:06 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:06 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:06 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:06 devstack sudo[76138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:02:06 devstack sudo[76138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:07 devstack sudo[76138]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:07 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.933s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:07 devstack cinder-volume[75648]: DEBUG cinder.brick.local_dev.lvm [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75648) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 06 12:02:07 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:07 devstack sudo[76299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:02:07 devstack sudo[76299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:08 devstack sudo[76299]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:08 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.122s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:08 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:08 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:08 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:08 devstack sudo[76427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:02:08 devstack sudo[76427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:09 devstack sudo[76427]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:09 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.713s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:09 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:09 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:09 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:09 devstack sudo[76433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 06 12:02:09 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:09 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:09 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.782s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:09 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:09 devstack sudo[76436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:02:09 devstack sudo[76436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:10 devstack sudo[76436]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:10 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.801s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:10 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:10 devstack sudo[76448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:02:10 devstack sudo[76448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:11 devstack sudo[76448]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:11 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.886s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:11 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:11 devstack sudo[76454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:02:11 devstack sudo[76454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:12 devstack sudo[76454]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:12 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.768s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:12 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:12 devstack sudo[76458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:02:12 devstack sudo[76458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:13 devstack sudo[76458]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:13 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.763s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:13 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:13 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:13 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:13 devstack sudo[76467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:02:13 devstack sudo[76467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:13 devstack sudo[76467]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:13 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.897s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:13 devstack cinder-volume[75648]: INFO cinder.volume.drivers.lvm [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 06 12:02:13 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:13 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:14 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:14 devstack sudo[76585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:02:14 devstack sudo[76585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:14 devstack cinder-volume[75474]: DEBUG dbcounter [-] [75474] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:02:14 devstack sudo[76585]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:14 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.722s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:14 devstack cinder-volume[75648]: DEBUG cinder.volume.drivers.lvm [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Updating volume stats {{(pid=75648) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:02:14 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:14 devstack sudo[76730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:02:14 devstack sudo[76730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:15 devstack sudo[76730]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:15 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:15 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:15 devstack sudo[76740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:02:15 devstack sudo[76740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:16 devstack sudo[76740]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:16 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:16 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:16 devstack sudo[76743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:02:16 devstack sudo[76743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:16 devstack sudo[76743]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:16 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:16 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:16 devstack sudo[76746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:02:16 devstack sudo[76746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:17 devstack sudo[76746]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:17 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:17 devstack cinder-volume[75648]: INFO cinder.volume.driver [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Driver hasn't implemented _init_vendor_properties() Jul 06 12:02:17 devstack cinder-volume[75648]: DEBUG cinder.volume.driver [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75648) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 12:02:17 devstack cinder-volume[75648]: DEBUG oslo_db.sqlalchemy.engines [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75648) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:02:17 devstack cinder-volume[75648]: DEBUG dbcounter [-] [75648] Writer thread running {{(pid=75648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:02:17 devstack cinder-volume[75648]: DEBUG cinder.db.api [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Building query based on filter {{(pid=75648) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 12:02:17 devstack cinder-volume[75648]: DEBUG cinder.image.image_utils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75648) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 12:02:17 devstack cinder-volume[75648]: INFO cinder.keymgr.migration [None req-36fc1ab1-5940-4ac3-948c-cb25498bd0ce None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 12:02:17 devstack cinder-volume[75648]: DEBUG cinder.volume.drivers.lvm [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Updating volume stats {{(pid=75648) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:02:17 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:17 devstack sudo[76751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:02:17 devstack sudo[76751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:18 devstack sudo[76751]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:18 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.737s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:18 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:18 devstack sudo[76758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:02:18 devstack sudo[76758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:19 devstack sudo[76758]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:19 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.740s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:19 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:19 devstack sudo[76762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:02:19 devstack sudo[76762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:19 devstack sudo[76762]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:19 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.669s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:19 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:19 devstack sudo[76765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:02:19 devstack sudo[76765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:20 devstack sudo[76765]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:20 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:20 devstack cinder-volume[75648]: DEBUG cinder.manager [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Notifying Schedulers of capabilities ... {{(pid=75648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:02:20 devstack cinder-volume[75648]: INFO cinder.volume.manager [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Driver initialization completed successfully. Jul 06 12:02:20 devstack cinder-volume[75648]: INFO cinder.manager [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Initiating service 2 cleanup Jul 06 12:02:20 devstack cinder-volume[75648]: INFO cinder.manager [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Service 2 cleanup completed. Jul 06 12:02:20 devstack cinder-volume[75648]: DEBUG cinder.service [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Creating RPC server for service cinder-volume {{(pid=75648) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 12:02:20 devstack cinder-volume[75648]: DEBUG cinder.service [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75648) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 12:02:20 devstack cinder-volume[75648]: INFO cinder.volume.manager [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 06 12:02:20 devstack cinder-volume[75648]: DEBUG cinder.volume.drivers.lvm [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Updating volume stats {{(pid=75648) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:02:20 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:20 devstack sudo[76769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:02:20 devstack sudo[76769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:21 devstack sudo[76769]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:21 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:21 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:21 devstack sudo[76793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:02:21 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:21 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:21 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:21 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:21 devstack sudo[76832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:02:21 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:22 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:22 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.691s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:22 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:02:22 devstack sudo[76835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:02:22 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:02:23 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root Jul 06 12:02:23 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:02:23 devstack cinder-volume[75648]: INFO cinder.volume.manager [None req-746bc5f8-6058-408c-ab1b-c866c44f67b3 None None] Driver post RPC initialization completed successfully. Jul 06 12:02:33 devstack cinder-volume[75648]: DEBUG dbcounter [-] [75648] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:02:33 devstack cinder-volume[75648]: DEBUG dbcounter [-] [75648] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:02:49 devstack cinder-volume[75648]: DEBUG oslo_service.periodic_task [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running periodic task VolumeManager._thread_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:02:49 devstack cinder-volume[75648]: DEBUG cinder.volume.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] thread count: 6 {{(pid=75648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:02:49 devstack cinder-volume[75648]: DEBUG cinder.volume.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] thread info: [<_MainThread(MainThread, started 124755616034944)>, , , , , ] {{(pid=75648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:03:49 devstack cinder-volume[75648]: DEBUG oslo_service.periodic_task [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:03:49 devstack cinder-volume[75648]: DEBUG cinder.volume.drivers.lvm [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Updating volume stats {{(pid=75648) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:03:49 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:49 devstack sudo[79157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:03:49 devstack sudo[79157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:50 devstack sudo[79157]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:50 devstack sudo[79162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:03:50 devstack sudo[79162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:50 devstack sudo[79162]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.731s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:50 devstack sudo[79167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:03:50 devstack sudo[79167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:51 devstack sudo[79167]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:51 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.744s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:51 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:03:51 devstack sudo[79294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:03:51 devstack sudo[79294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:03:52 devstack sudo[79294]: pam_unix(sudo:session): session closed for user root Jul 06 12:03:52 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:03:52 devstack cinder-volume[75648]: DEBUG cinder.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Notifying Schedulers of capabilities ... {{(pid=75648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:03:52 devstack cinder-volume[75648]: DEBUG oslo_service.periodic_task [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running periodic task VolumeManager._thread_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:03:52 devstack cinder-volume[75648]: DEBUG cinder.volume.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] thread count: 6 {{(pid=75648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:03:52 devstack cinder-volume[75648]: DEBUG cinder.volume.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] thread info: [<_MainThread(MainThread, started 124755616034944)>, , , , , ] {{(pid=75648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:04:33 devstack cinder-volume[75648]: DEBUG dbcounter [-] [75648] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:04:49 devstack cinder-volume[75648]: DEBUG oslo_service.periodic_task [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:04:49 devstack cinder-volume[75648]: DEBUG cinder.volume.drivers.lvm [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Updating volume stats {{(pid=75648) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:04:49 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:49 devstack sudo[82858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:04:49 devstack sudo[82858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:50 devstack sudo[82858]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:50 devstack sudo[82881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:04:50 devstack sudo[82881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:50 devstack sudo[82881]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:50 devstack sudo[82890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:04:50 devstack sudo[82890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:51 devstack sudo[82890]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:51 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:51 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:04:51 devstack sudo[82893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:04:51 devstack sudo[82893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:04:52 devstack sudo[82893]: pam_unix(sudo:session): session closed for user root Jul 06 12:04:52 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:04:52 devstack cinder-volume[75648]: DEBUG cinder.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Notifying Schedulers of capabilities ... {{(pid=75648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:04:52 devstack cinder-volume[75648]: DEBUG oslo_service.periodic_task [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running periodic task VolumeManager._thread_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:04:52 devstack cinder-volume[75648]: DEBUG cinder.volume.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] thread count: 6 {{(pid=75648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:04:52 devstack cinder-volume[75648]: DEBUG cinder.volume.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] thread info: [<_MainThread(MainThread, started 124755616034944)>, , , , , ] {{(pid=75648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:05:49 devstack cinder-volume[75648]: DEBUG oslo_service.periodic_task [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:05:49 devstack cinder-volume[75648]: DEBUG cinder.volume.drivers.lvm [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Updating volume stats {{(pid=75648) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:05:49 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:49 devstack sudo[84383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:05:49 devstack sudo[84383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:50 devstack sudo[84383]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.722s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:50 devstack sudo[84398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:05:50 devstack sudo[84398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:50 devstack sudo[84398]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:50 devstack sudo[84409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:05:50 devstack sudo[84409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:51 devstack sudo[84409]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:51 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.775s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:51 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:05:51 devstack sudo[84418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:05:51 devstack sudo[84418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:05:52 devstack sudo[84418]: pam_unix(sudo:session): session closed for user root Jul 06 12:05:52 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.790s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:05:52 devstack cinder-volume[75648]: DEBUG cinder.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Notifying Schedulers of capabilities ... {{(pid=75648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:05:52 devstack cinder-volume[75648]: DEBUG oslo_service.periodic_task [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running periodic task VolumeManager._thread_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:05:52 devstack cinder-volume[75648]: DEBUG cinder.volume.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] thread count: 6 {{(pid=75648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:05:52 devstack cinder-volume[75648]: DEBUG cinder.volume.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] thread info: [<_MainThread(MainThread, started 124755616034944)>, , , , , ] {{(pid=75648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:06:33 devstack cinder-volume[75648]: DEBUG dbcounter [-] [75648] Writing DB stats cinder:SELECT=1 {{(pid=75648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:06:33 devstack cinder-volume[75648]: DEBUG dbcounter [-] [75648] Writing DB stats cinder:UPDATE=1 {{(pid=75648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:06:49 devstack cinder-volume[75648]: DEBUG oslo_service.periodic_task [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:06:49 devstack cinder-volume[75648]: DEBUG cinder.volume.drivers.lvm [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Updating volume stats {{(pid=75648) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 12:06:49 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:49 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 12:06:49 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:50 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.727s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:50 devstack sudo[85366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:06:50 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:50 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.750s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:50 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:50 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 12:06:50 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:51 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:51 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.753s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:51 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:06:51 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 12:06:51 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:06:52 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Jul 06 12:06:52 devstack cinder-volume[75648]: DEBUG oslo_concurrency.processutils [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:06:52 devstack cinder-volume[75648]: DEBUG cinder.manager [None req-fd89ad9f-515d-406f-992f-010461d7ecb3 None None] Notifying Schedulers of capabilities ... {{(pid=75648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:02 devstack cinder-volume[75474]: INFO oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Caught SIGTERM, stopping children Jul 06 12:07:02 devstack cinder-volume[75474]: DEBUG oslo_concurrency.lockutils [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Acquiring lock "singleton_lock" {{(pid=75474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:07:02 devstack cinder-volume[75474]: DEBUG oslo_concurrency.lockutils [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Acquired lock "singleton_lock" {{(pid=75474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:07:02 devstack cinder-volume[75474]: DEBUG oslo_concurrency.lockutils [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Releasing lock "singleton_lock" {{(pid=75474) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:07:02 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Stop services. {{(pid=75474) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 12:07:02 devstack cinder-volume[75474]: DEBUG oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Killing children. {{(pid=75474) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 12:07:02 devstack cinder-volume[75474]: INFO oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Waiting on 1 children to exit Jul 06 12:07:05 devstack cinder-volume[75648]: DEBUG oslo_concurrency.lockutils [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Acquiring lock "singleton_lock" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:07:05 devstack cinder-volume[75648]: DEBUG oslo_concurrency.lockutils [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Acquired lock "singleton_lock" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:07:05 devstack cinder-volume[75648]: DEBUG oslo_concurrency.lockutils [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Releasing lock "singleton_lock" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:07:05 devstack cinder-volume[75648]: WARNING amqp [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:07:05 devstack cinder-volume[75648]: WARNING amqp [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:07:05 devstack cinder-volume[75474]: INFO oslo_service.backend._eventlet.service [None req-5c78ff7b-2eae-4c95-b740-36b3f6381217 None None] Child 75648 exited with status 0 Jul 06 12:07:06 devstack cinder-volume[85789]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 12:07:06 devstack cinder-volume[85789]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:07:06 devstack cinder-volume[85789]: we strongly recommend against using it for new projects. Jul 06 12:07:06 devstack cinder-volume[85789]: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:07:06 devstack cinder-volume[85789]: framework. For more detail see Jul 06 12:07:06 devstack cinder-volume[85789]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:07:06 devstack cinder-volume[85789]: import eventlet # noqa Jul 06 12:07:08 devstack cinder-volume[85789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:07:08 devstack cinder-volume[85789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:07:08 devstack cinder-volume[85789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:07:09 devstack cinder-volume[85789]: INFO dbcounter [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Registered counter for database cinder Jul 06 12:07:09 devstack cinder-volume[85789]: DEBUG oslo_db.sqlalchemy.engines [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:07:09 devstack cinder-volume[85789]: DEBUG dbcounter [-] [85789] Writer thread running {{(pid=85789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:07:09 devstack cinder-volume[85789]: INFO cinder.rpc [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 12:07:09 devstack cinder-volume[85789]: INFO cinder.rpc [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 12:07:09 devstack cinder-volume[85789]: DEBUG oslo_db.sqlalchemy.engines [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:07:09 devstack cinder-volume[85789]: INFO cinder.volume.manager [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Determined volume DB was empty at startup. Jul 06 12:07:09 devstack cinder-volume[85789]: DEBUG cinder.volume.manager [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85789) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 12:07:09 devstack cinder-volume[85789]: INFO cinder.volume.manager [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 12:07:09 devstack cinder-volume[85789]: WARNING stevedore.named [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:07:09 devstack cinder-volume[85789]: WARNING castellan.key_manager [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:07:09 devstack cinder-volume[85789]: WARNING cinder.keymgr.conf_key_mgr [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:07:09 devstack cinder-volume[85789]: INFO cinder.volume.manager [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 12:07:09 devstack cinder-volume[85789]: DEBUG oslo_db.sqlalchemy.engines [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:07:10 devstack cinder-volume[85789]: INFO oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Starting 1 workers Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Started child 86006 {{(pid=85789) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 12:07:10 devstack cinder-volume[86006]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Full set of CONF: {{(pid=85789) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] ******************************************************************************** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Configuration options gathered from: {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] ================================================================================ {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] allow_availability_zone_fallback = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] allow_compression_on_image_upload = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] allowed_direct_url_schemes = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] api_rate_limit = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] auth_strategy = keystone {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_availability_zone = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_host = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_stats_polling_interval = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backup_api_class = cinder.backup.api.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backup_name_template = backup-%s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backup_use_same_host = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backup_use_temp_snapshot = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] chap_password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] chap_username = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cinder_internal_tenant_project_id = 35e37e29e889410e8e9d780c33e735c4 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cinder_internal_tenant_user_id = 560dfb1324d640de8fb73526bd797ef1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cluster = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] compression_format = gzip {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] compute_api_class = cinder.compute.nova.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] config_dir = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] config_source = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] control_exchange = openstack {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] debug = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] default_availability_zone = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] default_group_type = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[86006]: INFO cinder.volume.manager [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 12:07:10 devstack cinder-volume[86006]: DEBUG cinder.volume.drivers.remotefs [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86006) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] default_volume_type = QuobyteHD {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] disk_geometry = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] driver_client_cert = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] driver_client_cert_key = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] driver_data_namespace = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] driver_ssl_cert_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] driver_ssl_cert_verify = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] driver_use_ssl = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] enable_new_services = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] enable_unsupported_driver = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] enabled_backends = ['QuobyteHD'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] enforce_multipath_for_image_xfer = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] filter_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance_api_insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance_api_ssl_compression = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance_ca_certificates_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance_catalog_info = image:glance:publicURL {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance_certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance_keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance_num_retries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance_request_timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] goodness_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] graceful_shutdown_timeout = 5 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] group_api_class = cinder.group.api.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] host = devstack {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] image_compress_on_upload = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] image_conversion_address_space_limit = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] image_conversion_cpu_limit = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] image_conversion_disable = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] image_upload_use_cinder_backend = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] image_upload_use_internal_tenant = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] image_volume_cache_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] image_volume_cache_max_count = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] image_volume_cache_max_size_gb = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] init_host_max_objects_retrieval = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] instance_format = [instance: %(uuid)s] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] iscsi_target_flags = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] iscsi_write_cache = on {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] iser_helper = tgtadm {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] iser_ip_address = 192.168.122.128 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] iser_port = 3260 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] log_color = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] log_config_append = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] log_dir = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] log_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] log_options = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] log_rotate_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] log_rotate_interval_type = days {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] log_rotation_type = none {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] max_age = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] max_logfile_count = 30 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] max_logfile_size_mb = 200 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] max_over_subscription_ratio = 20.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[86006]: DEBUG cinder.volume.drivers.quobyte [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86006) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] message_reap_interval = 86400 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[86006]: WARNING cinder.volume.drivers.quobyte [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 12:07:10 devstack cinder-volume[86006]: WARNING cinder.volume.drivers.quobyte [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] message_ttl = 2592000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] migration_create_volume_timeout_secs = 300 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] monkey_patch = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] monkey_patch_modules = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] my_ip = 192.168.122.128 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] no_snapshot_gb_quota = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] num_iser_scan_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] num_shell_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Running cmd (subprocess): mount.quobyte {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] num_volume_device_scan_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] nvmeof_conn_info_version = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] nvmet_ns_id = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] nvmet_port_id = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] osapi_max_limit = 1000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] osapi_volume_ext_list = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] osapi_volume_listen_port = 8776 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] osapi_volume_use_ssl = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] osapi_volume_workers = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] per_volume_size_limit = -1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] periodic_fuzzy_delay = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] periodic_interval = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] public_endpoint = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] publish_errors = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] quota_backup_gigabytes = 1000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] quota_backups = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] quota_gigabytes = 1000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] quota_groups = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] quota_snapshots = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] quota_volumes = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] rate_limit_burst = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] rate_limit_except_level = CRITICAL {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] rate_limit_interval = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] reinit_driver_count = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] replication_device = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] report_discard_supported = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] report_interval = 120 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] reservation_clean_interval = 86400 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] reservation_expire = 86400 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] reserved_image_namespaces = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] reserved_percentage = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] rpc_response_timeout = 120 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] run_external_periodic_tasks = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] scst_target_driver = iscsi {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] scst_target_iqn_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] service_down_time = 720 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] shell_completion = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] snapshot_name_template = snapshot-%s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] split_loggers = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] state_path = /opt/stack/data/cinder {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] storage_availability_zone = nova {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] storage_protocol = iSCSI {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] syslog_log_facility = LOG_USER {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] target_helper = lioadm {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] target_ip_address = 192.168.122.128 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] target_port = 3260 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] target_protocol = iscsi {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] target_secondary_ip_addresses = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] trace_flags = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] transport_url = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] until_refresh = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] use_chap_auth = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] use_default_quota_class = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] use_journal = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] use_json = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] use_multipath_for_image_xfer = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] use_stderr = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] use_syslog = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] verify_glance_signatures = enabled {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_api_class = cinder.volume.api.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_backend_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_clear = zero {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_clear_ionice = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_clear_size = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_copy_bps_limit = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_dd_blocksize = 1M {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_name_template = volume-%s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_service_inithost_offload = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volume_usage_audit_period = month {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] zoning_mode = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_concurrency.disable_process_locking = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.auth_section = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.auth_type = password {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.auth_version = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.cache = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.include_service_catalog = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.interface = public {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_password = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack quobyte-client[86011]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcache_username = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack quobyte-client[86011]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.region_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.service_type = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.backend = dogpile.cache.null {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.backend_argument = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.backend_expiration_time = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.config_prefix = cache.oslo {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.debug_cache_backend = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.enable_retry_client = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.enable_socket_keepalive = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.expiration_time = 600 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.hashclient_retry_attempts = 2 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] CMD "mount.quobyte" returned: 1 in 0.102s {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.memcache_dead_retry = 300 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.memcache_pool_maxsize = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.memcache_sasl_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.proxies = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.redis_db = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.redis_server = localhost:6379 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.retry_attempts = 2 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.retry_delay = 0.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.socket_keepalive_count = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.socket_keepalive_idle = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.socket_keepalive_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[86006]: DEBUG cinder.volume.drivers.quobyte [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86006) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.socket_timeout = 1.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.tls_allowed_ciphers = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.tls_cafile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.tls_certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.tls_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[86006]: INFO cinder.volume.drivers.quobyte [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 ... Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.tls_keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d -c /etc/quobyte/client-cinder.cfg {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cache.username = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] coordination.backend_url = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.asyncio_connection = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.asyncio_slave_connection = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.backend = sqlalchemy {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.connection = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.connection_debug = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.connection_parameters = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.connection_recycle_time = 3600 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.connection_trace = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.db_inc_retry_interval = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.db_max_retries = 20 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.db_max_retry_interval = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.db_retry_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.max_overflow = 50 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.max_pool_size = 5 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.max_retries = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.mysql_wsrep_sync_wait = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.pool_timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.retry_interval = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.slave_connection = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.sqlite_synchronous = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.synchronous_reader = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] database.use_db_reconnect = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler.connection_string = messaging:// {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler.enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler.es_doc_type = notification {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler.es_scroll_size = 10000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler.es_scroll_time = 2m {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler.filter_error_trace = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler.hmac_keys = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler.sentinel_service_name = mymaster {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler.socket_timeout = 0.1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler.trace_requests = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler.trace_sqlalchemy = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler_jaeger.process_tags = {} {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler_jaeger.service_name_prefix = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] profiler_otlp.service_name_prefix = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_policy.enforce_new_defaults = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_policy.enforce_scope = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_policy.policy_default_rule = default {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_policy.policy_file = policy.yaml {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] privsep_osbrick.group = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] privsep_osbrick.helper_command = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] privsep_osbrick.user = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cinder_sys_admin.group = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cinder_sys_admin.helper_command = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] cinder_sys_admin.user = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] service_user.auth_section = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] service_user.auth_type = password {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] service_user.cafile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] service_user.certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] service_user.collect_timing = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] service_user.insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] service_user.keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] service_user.send_service_user_token = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] service_user.split_loggers = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] service_user.timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance.auth_section = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance.auth_type = password {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance.certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance.collect_timing = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance.insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance.keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance.region_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance.split_loggers = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] glance.timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.backend_availability_zone = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.chap_password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.chap_username = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.disk_geometry = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.driver_client_cert = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.driver_client_cert_key = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.driver_data_namespace = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.driver_use_ssl = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.extra_capabilities = {} {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.filter_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.goodness_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d -c /etc/quobyte/client-cinder.cfg Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.iscsi_target_flags = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.iscsi_write_cache = on {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.iser_helper = tgtadm {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.iser_port = 3260 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nas_host = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nas_login = admin {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nas_mount_options = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nas_password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nas_private_key = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nas_share_path = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.num_shell_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.quobyte_volume_url = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.replication_device = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.report_discard_supported = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.reserved_percentage = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.target_helper = tgtadm {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.target_port = 3260 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.target_protocol = iscsi {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.trace_flags = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.unique_fqdn_network = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.use_chap_auth = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.volume_backend_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.volume_clear = zero {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.volume_clear_ionice = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.volume_clear_size = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_reports.file_event_handler = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_reports.log_dir = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.backend_availability_zone = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.backend_host = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.chap_password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.chap_username = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.chiscsi_conf = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.disk_geometry = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.driver_client_cert = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.driver_data_namespace = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.driver_use_ssl = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.extra_capabilities = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.filter_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.goodness_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.iser_helper = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.iser_ip_address = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.iser_port = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.iser_target_prefix = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nas_host = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nas_login = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nas_mount_options = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nas_password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nas_private_key = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nas_share_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nas_ssh_port = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.num_shell_tries = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.nvmet_port_id = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.replication_device = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.report_discard_supported = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.reserved_percentage = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.scst_target_driver = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.storage_protocol = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.target_helper = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.target_ip_address = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.target_port = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.target_prefix = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.target_protocol = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.trace_flags = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.use_chap_auth = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.volume_clear = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.volume_clear_size = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] QuobyteHD.volumes_dir = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.ssl = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_notifications.driver = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_notifications.retry = -1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] key_manager.fixed_key = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.barbican_api_version = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.barbican_endpoint = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.barbican_endpoint_type = public {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.barbican_region_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.cafile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.collect_timing = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.number_of_retries = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.retry_delay = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.send_service_user_token = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.split_loggers = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.verify_ssl = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican.verify_ssl_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican_service_user.auth_section = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican_service_user.auth_type = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican_service_user.cafile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican_service_user.certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican_service_user.collect_timing = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican_service_user.insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican_service_user.keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican_service_user.split_loggers = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] barbican_service_user.timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vault.approle_role_id = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vault.approle_secret_id = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vault.kv_mountpoint = secret {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vault.kv_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vault.kv_version = 2 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vault.namespace = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vault.root_token_id = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vault.ssl_ca_crt_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vault.timeout = 60.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vault.use_ssl = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:10 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] ******************************************************************************** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 12:07:11 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:11 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.914s {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:11 devstack cinder-volume[86006]: INFO cinder.volume.drivers.quobyte [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 succeeded Jul 06 12:07:11 devstack cinder-volume[86006]: DEBUG cinder.volume.drivers.quobyte [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86006) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:11 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.935s {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:11 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:11 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:07:11 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:12 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.852s {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:12 devstack cinder-volume[86006]: INFO cinder.volume.driver [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Driver hasn't implemented _init_vendor_properties() Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG cinder.volume.driver [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7533416748047, 'free_capacity_gb': 1775.7533416748047, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86006) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG oslo_db.sqlalchemy.engines [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86006) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG dbcounter [-] [86006] Writer thread running {{(pid=86006) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG cinder.db.api [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Building query based on filter {{(pid=86006) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG cinder.image.image_utils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86006) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 12:07:12 devstack cinder-volume[86006]: INFO cinder.keymgr.migration [None req-847966cc-d8b5-49fe-9850-114eab70da7c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG cinder.volume.drivers.quobyte [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86006) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG cinder.volume.drivers.quobyte [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86006) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:12 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:12 devstack sudo[86110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:07:12 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:13 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:13 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.081s {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:13 devstack cinder-volume[86006]: DEBUG cinder.manager [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Notifying Schedulers of capabilities ... {{(pid=86006) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:13 devstack cinder-volume[86006]: INFO cinder.volume.manager [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Driver initialization completed successfully. Jul 06 12:07:13 devstack cinder-volume[86006]: INFO cinder.manager [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Initiating service 3 cleanup Jul 06 12:07:13 devstack cinder-volume[86006]: INFO cinder.manager [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Service 3 cleanup completed. Jul 06 12:07:13 devstack cinder-volume[86006]: DEBUG cinder.service [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Creating RPC server for service cinder-volume {{(pid=86006) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 12:07:13 devstack cinder-volume[86006]: DEBUG cinder.service [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86006) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 12:07:13 devstack cinder-volume[86006]: INFO cinder.volume.manager [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 12:07:13 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:13 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:13 devstack cinder-volume[86006]: DEBUG cinder.volume.drivers.quobyte [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86006) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:13 devstack cinder-volume[86006]: DEBUG cinder.volume.drivers.quobyte [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86006) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:13 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:13 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:13 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:07:13 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:14 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:14 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.822s {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:14 devstack cinder-volume[86006]: INFO cinder.volume.manager [None req-035987a5-1b24-42c1-aeba-361418ff948b None None] Driver post RPC initialization completed successfully. Jul 06 12:07:16 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-74a8e51b-2fa2-4d32-8ded-e0b34914badc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:16 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-74a8e51b-2fa2-4d32-8ded-e0b34914badc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:16 devstack cinder-volume[86006]: DEBUG cinder.volume.drivers.quobyte [None req-74a8e51b-2fa2-4d32-8ded-e0b34914badc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86006) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:16 devstack cinder-volume[86006]: DEBUG cinder.volume.drivers.quobyte [None req-74a8e51b-2fa2-4d32-8ded-e0b34914badc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86006) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:16 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-74a8e51b-2fa2-4d32-8ded-e0b34914badc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86006) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:16 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-74a8e51b-2fa2-4d32-8ded-e0b34914badc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:16 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:07:16 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:17 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:17 devstack cinder-volume[86006]: DEBUG oslo_concurrency.processutils [None req-74a8e51b-2fa2-4d32-8ded-e0b34914badc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.683s {{(pid=86006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:17 devstack cinder-volume[86006]: DEBUG cinder.manager [None req-74a8e51b-2fa2-4d32-8ded-e0b34914badc None None] Notifying Schedulers of capabilities ... {{(pid=86006) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:18 devstack cinder-volume[85789]: INFO oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Caught SIGTERM, stopping children Jul 06 12:07:18 devstack cinder-volume[85789]: DEBUG oslo_concurrency.lockutils [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Acquiring lock "singleton_lock" {{(pid=85789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:07:18 devstack cinder-volume[85789]: DEBUG oslo_concurrency.lockutils [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Acquired lock "singleton_lock" {{(pid=85789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:07:18 devstack cinder-volume[85789]: DEBUG oslo_concurrency.lockutils [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Releasing lock "singleton_lock" {{(pid=85789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:07:18 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Stop services. {{(pid=85789) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 12:07:18 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Killing children. {{(pid=85789) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 12:07:18 devstack cinder-volume[85789]: INFO oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Waiting on 1 children to exit Jul 06 12:07:21 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Acquiring lock "singleton_lock" {{(pid=86006) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:07:21 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Acquired lock "singleton_lock" {{(pid=86006) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:07:21 devstack cinder-volume[86006]: DEBUG oslo_concurrency.lockutils [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Releasing lock "singleton_lock" {{(pid=86006) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:07:21 devstack cinder-volume[86006]: WARNING amqp [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:07:21 devstack cinder-volume[86006]: WARNING amqp [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 12:07:21 devstack cinder-volume[85789]: INFO oslo_service.backend._eventlet.service [None req-c6f0c772-f143-47d7-bba2-b162b9082648 None None] Child 86006 exited with status 0 Jul 06 12:07:22 devstack cinder-volume[86290]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 12:07:22 devstack cinder-volume[86290]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:07:22 devstack cinder-volume[86290]: we strongly recommend against using it for new projects. Jul 06 12:07:22 devstack cinder-volume[86290]: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:07:22 devstack cinder-volume[86290]: framework. For more detail see Jul 06 12:07:22 devstack cinder-volume[86290]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:07:22 devstack cinder-volume[86290]: import eventlet # noqa Jul 06 12:07:25 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86290) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 12:07:25 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86290) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 12:07:25 devstack cinder-volume[86290]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86290) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 12:07:26 devstack cinder-volume[86290]: INFO dbcounter [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Registered counter for database cinder Jul 06 12:07:26 devstack cinder-volume[86290]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:07:26 devstack cinder-volume[86290]: DEBUG dbcounter [-] [86290] Writer thread running {{(pid=86290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:07:26 devstack cinder-volume[86290]: INFO cinder.rpc [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 12:07:26 devstack cinder-volume[86290]: INFO cinder.rpc [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 12:07:26 devstack cinder-volume[86290]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:07:26 devstack cinder-volume[86290]: INFO cinder.volume.manager [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Determined volume DB was empty at startup. Jul 06 12:07:26 devstack cinder-volume[86290]: DEBUG cinder.volume.manager [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86290) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 12:07:26 devstack cinder-volume[86290]: WARNING stevedore.named [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 12:07:26 devstack cinder-volume[86290]: WARNING castellan.key_manager [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:07:26 devstack cinder-volume[86290]: WARNING cinder.keymgr.conf_key_mgr [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 12:07:26 devstack cinder-volume[86290]: INFO cinder.volume.manager [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 12:07:26 devstack cinder-volume[86290]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:07:27 devstack cinder-volume[86290]: INFO oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Starting 1 workers Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Started child 86561 {{(pid=86290) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Full set of CONF: {{(pid=86290) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] ******************************************************************************** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] Configuration options gathered from: {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 12:07:27 devstack cinder-volume[86561]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] ================================================================================ {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] allow_availability_zone_fallback = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] allow_compression_on_image_upload = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] allowed_direct_url_schemes = [] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] api_rate_limit = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] auth_strategy = keystone {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_availability_zone = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_host = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_name = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_stats_polling_interval = 60 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backup_api_class = cinder.backup.api.API {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backup_name_template = backup-%s {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backup_use_same_host = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backup_use_temp_snapshot = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] chap_password = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] chap_username = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cinder_internal_tenant_project_id = 35e37e29e889410e8e9d780c33e735c4 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cinder_internal_tenant_user_id = 560dfb1324d640de8fb73526bd797ef1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cluster = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] compression_format = gzip {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] compute_api_class = cinder.compute.nova.API {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] config_dir = [] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] config_source = [] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] control_exchange = openstack {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] debug = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] default_availability_zone = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] default_group_type = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] default_volume_type = QuobyteHD {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] disk_geometry = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] driver_client_cert = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] driver_client_cert_key = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] driver_data_namespace = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] driver_ssl_cert_path = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] driver_ssl_cert_verify = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] driver_use_ssl = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] enable_new_services = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] enable_unsupported_driver = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] enabled_backends = ['QuobyteHD'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] enforce_multipath_for_image_xfer = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] filter_function = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance_api_insecure = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance_api_servers = ['http://192.168.122.128/image'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance_api_ssl_compression = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance_ca_certificates_file = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance_catalog_info = image:glance:publicURL {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance_certfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance_keyfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance_num_retries = 3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance_request_timeout = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] goodness_function = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] graceful_shutdown_timeout = 5 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] group_api_class = cinder.group.api.API {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] host = devstack {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] image_compress_on_upload = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] image_conversion_address_space_limit = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] image_conversion_cpu_limit = 60 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] image_conversion_disable = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] image_upload_use_cinder_backend = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] image_upload_use_internal_tenant = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] image_volume_cache_enabled = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] image_volume_cache_max_count = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] image_volume_cache_max_size_gb = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] init_host_max_objects_retrieval = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] instance_format = [instance: %(uuid)s] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] iscsi_target_flags = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] iscsi_write_cache = on {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] iser_helper = tgtadm {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] iser_ip_address = 192.168.122.128 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] iser_port = 3260 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] log_color = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] log_config_append = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] log_dir = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] log_file = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] log_options = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] log_rotate_interval = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] log_rotate_interval_type = days {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] log_rotation_type = none {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] max_age = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] max_logfile_count = 30 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] max_logfile_size_mb = 200 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] max_over_subscription_ratio = 20.0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] message_reap_interval = 86400 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] message_ttl = 2592000 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] migration_create_volume_timeout_secs = 300 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] monkey_patch = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] monkey_patch_modules = [] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] my_ip = 192.168.122.128 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] no_snapshot_gb_quota = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] num_iser_scan_tries = 3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] num_shell_tries = 3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] num_volume_device_scan_tries = 3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] nvmeof_conn_info_version = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] nvmet_ns_id = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] nvmet_port_id = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] osapi_max_limit = 1000 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] osapi_volume_ext_list = [] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] osapi_volume_listen_port = 8776 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] osapi_volume_use_ssl = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] osapi_volume_workers = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] per_volume_size_limit = -1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] periodic_fuzzy_delay = 60 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] periodic_interval = 60 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] public_endpoint = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] publish_errors = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] quota_backup_gigabytes = 1000 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] quota_backups = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] quota_gigabytes = 1000 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] quota_groups = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] quota_snapshots = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] quota_volumes = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] rate_limit_burst = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] rate_limit_except_level = CRITICAL {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] rate_limit_interval = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] reinit_driver_count = 3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] replication_device = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] report_discard_supported = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] report_interval = 120 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] reservation_clean_interval = 86400 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] reservation_expire = 86400 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] reserved_image_namespaces = [] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] reserved_percentage = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] rpc_response_timeout = 120 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] run_external_periodic_tasks = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] scst_target_driver = iscsi {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] scst_target_iqn_name = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] service_down_time = 720 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] shell_completion = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] snapshot_name_template = snapshot-%s {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] split_loggers = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] state_path = /opt/stack/data/cinder {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] storage_availability_zone = nova {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] storage_protocol = iSCSI {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] syslog_log_facility = LOG_USER {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] target_helper = lioadm {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] target_ip_address = 192.168.122.128 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] target_port = 3260 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] target_protocol = iscsi {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] target_secondary_ip_addresses = [] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] trace_flags = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] transport_url = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] until_refresh = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] use_chap_auth = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] use_default_quota_class = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] use_journal = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] use_json = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] use_multipath_for_image_xfer = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] use_stderr = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] use_syslog = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] verify_glance_signatures = enabled {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_api_class = cinder.volume.api.API {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_backend_name = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_clear = zero {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_clear_ionice = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_clear_size = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_copy_bps_limit = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_dd_blocksize = 1M {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_name_template = volume-%s {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_service_inithost_offload = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volume_usage_audit_period = month {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] zoning_mode = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_concurrency.disable_process_locking = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86561) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.auth_section = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.auth_type = password {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.auth_version = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.cache = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.certfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.include_service_catalog = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.insecure = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.interface = public {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.keyfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_password = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcache_username = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.region_name = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.service_type = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.128/identity {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.backend = dogpile.cache.null {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.backend_argument = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.backend_expiration_time = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.config_prefix = cache.oslo {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.debug_cache_backend = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.enable_retry_client = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.enable_socket_keepalive = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.enabled = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.expiration_time = 600 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.hashclient_retry_attempts = 2 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.memcache_dead_retry = 300 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.memcache_pool_maxsize = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.memcache_sasl_enabled = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.password = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.proxies = [] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.redis_db = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.redis_server = localhost:6379 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.retry_attempts = 2 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.retry_delay = 0.0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.socket_keepalive_count = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.socket_keepalive_idle = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.socket_keepalive_interval = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.socket_timeout = 1.0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.tls_allowed_ciphers = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.tls_cafile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.tls_certfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.tls_enabled = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.tls_keyfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cache.username = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] coordination.backend_url = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.asyncio_connection = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.asyncio_slave_connection = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.backend = sqlalchemy {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.connection = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.connection_debug = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.connection_parameters = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.connection_recycle_time = 3600 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.connection_trace = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.db_inc_retry_interval = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.db_max_retries = 20 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.db_max_retry_interval = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.db_retry_interval = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.max_overflow = 50 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.max_pool_size = 5 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.max_retries = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.mysql_wsrep_sync_wait = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.pool_timeout = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.retry_interval = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.slave_connection = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.sqlite_synchronous = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.synchronous_reader = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] database.use_db_reconnect = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler.connection_string = messaging:// {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler.enabled = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler.es_doc_type = notification {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler.es_scroll_size = 10000 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler.es_scroll_time = 2m {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler.filter_error_trace = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler.hmac_keys = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler.sentinel_service_name = mymaster {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler.socket_timeout = 0.1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler.trace_requests = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler.trace_sqlalchemy = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler_jaeger.process_tags = {} {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler_jaeger.service_name_prefix = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] profiler_otlp.service_name_prefix = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_policy.enforce_new_defaults = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_policy.enforce_scope = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_policy.policy_default_rule = default {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_policy.policy_file = policy.yaml {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] privsep_osbrick.group = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] privsep_osbrick.helper_command = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] privsep_osbrick.user = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cinder_sys_admin.group = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cinder_sys_admin.helper_command = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] cinder_sys_admin.user = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] service_user.auth_section = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] service_user.auth_type = password {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] service_user.cafile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] service_user.certfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] service_user.collect_timing = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] service_user.insecure = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] service_user.keyfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] service_user.send_service_user_token = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] service_user.split_loggers = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] service_user.timeout = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance.auth_section = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance.auth_type = password {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance.certfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance.collect_timing = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance.insecure = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance.keyfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance.region_name = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance.split_loggers = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] glance.timeout = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.backend_availability_zone = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.chap_password = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.chap_username = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.disk_geometry = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.driver_client_cert = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.driver_client_cert_key = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.driver_data_namespace = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.driver_use_ssl = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.extra_capabilities = {} {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.filter_function = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.goodness_function = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.iscsi_target_flags = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.iscsi_write_cache = on {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.iser_helper = tgtadm {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.iser_port = 3260 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nas_host = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nas_login = admin {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nas_mount_options = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nas_password = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nas_private_key = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nas_share_path = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.num_shell_tries = 3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.quobyte_volume_url = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.replication_device = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.report_discard_supported = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.reserved_percentage = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.target_helper = tgtadm {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.target_port = 3260 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.target_protocol = iscsi {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.trace_flags = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.unique_fqdn_network = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.use_chap_auth = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.volume_backend_name = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.volume_clear = zero {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.volume_clear_ionice = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.volume_clear_size = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_reports.file_event_handler = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_reports.log_dir = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.backend_availability_zone = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.backend_host = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.chap_password = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.chap_username = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.chiscsi_conf = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.disk_geometry = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.driver_client_cert = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.driver_data_namespace = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.driver_use_ssl = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.extra_capabilities = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.filter_function = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.goodness_function = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.iser_helper = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.iser_ip_address = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86561) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.iser_port = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.iser_target_prefix = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nas_host = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.quobyte [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 12:07:27 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.quobyte [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nas_login = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nas_mount_options = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nas_password = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nas_private_key = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Running cmd (subprocess): mount.quobyte {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nas_share_path = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nas_ssh_port = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.num_shell_tries = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.nvmet_port_id = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.replication_device = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.report_discard_supported = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.reserved_percentage = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.scst_target_driver = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.storage_protocol = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.target_helper = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.target_ip_address = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.target_port = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.target_prefix = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.target_protocol = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.trace_flags = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.use_chap_auth = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.volume_clear = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.volume_clear_size = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] QuobyteHD.volumes_dir = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.ssl = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_notifications.driver = [] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_notifications.retry = -1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] key_manager.fixed_key = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.barbican_api_version = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.barbican_endpoint = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.barbican_endpoint_type = public {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.barbican_region_name = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.cafile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.certfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.collect_timing = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.insecure = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.keyfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.number_of_retries = 60 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.retry_delay = 1 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.send_service_user_token = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.split_loggers = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.timeout = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.verify_ssl = True {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican.verify_ssl_path = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican_service_user.auth_section = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican_service_user.auth_type = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican_service_user.cafile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican_service_user.certfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican_service_user.collect_timing = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican_service_user.insecure = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican_service_user.keyfile = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican_service_user.split_loggers = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack quobyte-client[86565]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] barbican_service_user.timeout = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vault.approle_role_id = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vault.approle_secret_id = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack quobyte-client[86565]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vault.kv_mountpoint = secret {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vault.kv_path = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vault.kv_version = 2 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vault.namespace = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vault.root_token_id = **** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vault.ssl_ca_crt_file = None {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vault.timeout = 60.0 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vault.use_ssl = False {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 12:07:27 devstack cinder-volume[86290]: DEBUG oslo_service.backend._eventlet.service [None req-a6b48822-5e71-414f-9379-95f95d49b069 None None] ******************************************************************************** {{(pid=86290) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 12:07:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:27 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:07:27 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:28 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.745s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:28 devstack cinder-volume[86561]: INFO cinder.volume.driver [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Driver hasn't implemented _init_vendor_properties() Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.driver [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7288703918457, 'free_capacity_gb': 1775.7288703918457, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86561) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_db.sqlalchemy.engines [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writer thread running {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.db.api [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Building query based on filter {{(pid=86561) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86561) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:28 devstack cinder-volume[86561]: INFO cinder.keymgr.migration [None req-f04af13d-925c-40a3-8078-fe25cf49fc46 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 12:07:28 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:07:28 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:28 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.761s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:28 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:07:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Driver initialization completed successfully. Jul 06 12:07:29 devstack cinder-volume[86561]: INFO cinder.manager [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Initiating service 3 cleanup Jul 06 12:07:29 devstack cinder-volume[86561]: INFO cinder.manager [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Service 3 cleanup completed. Jul 06 12:07:29 devstack cinder-volume[86561]: DEBUG cinder.service [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Creating RPC server for service cinder-volume {{(pid=86561) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 12:07:29 devstack cinder-volume[86561]: DEBUG cinder.service [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86561) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 12:07:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 12:07:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:07:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:07:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:07:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:07:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:07:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:07:29 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:07:29 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:07:29 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Jul 06 12:07:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.681s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:07:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-10e05b0a-13dd-4dc5-8fea-d0db47c024e0 None None] Driver post RPC initialization completed successfully. Jul 06 12:07:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:07:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 6 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:07:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:07:37 devstack cinder-volume[86290]: DEBUG dbcounter [-] [86290] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86290) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:07:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:07:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:08:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:08:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:08:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:08:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:08:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:08:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:08:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:08:32 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:08:32 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:08:33 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Jul 06 12:08:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.986s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:08:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:08:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:08:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 6 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:08:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Flow 'volume_create_manager' (9cb323c2-ed8c-420e-9b8c-905549128940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e25599-95ef-49ef-96e6-24eacbe06efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e25599-95ef-49ef-96e6-24eacbe06efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-653263796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249acc4d-59bd-4661-87d3-27f62ba74358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811e3873165e460e82da614f9013a67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:05Z,use_quota=True,user_id='1f5fda7639d445978a90e7a5d4a6f18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d972ab3-3981-4145-84dd-aae117b843d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d972ab3-3981-4145-84dd-aae117b843d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e335e38a-ff1a-45b4-b524-a42fabad67f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e335e38a-ff1a-45b4-b524-a42fabad67f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249acc4d-59bd-4661-87d3-27f62ba74358', 'volume_name': 'volume-249acc4d-59bd-4661-87d3-27f62ba74358', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d2bd99-3b3b-4668-a0c6-e249f9b39696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d2bd99-3b3b-4668-a0c6-e249f9b39696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac6df99-f628-44fb-870a-4119879d49a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Volume 249acc4d-59bd-4661-87d3-27f62ba74358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249acc4d-59bd-4661-87d3-27f62ba74358', 'volume_size': 1} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-653263796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249acc4d-59bd-4661-87d3-27f62ba74358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811e3873165e460e82da614f9013a67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:05Z,use_quota=True,user_id='1f5fda7639d445978a90e7a5d4a6f18a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Creating volume 249acc4d-59bd-4661-87d3-27f62ba74358 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:05 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:09:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:05 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358 1073741824 Jul 06 12:09:05 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:08 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358 1073741824" returned: 0 in 2.462s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:08 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358 Jul 06 12:09:08 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Flow 'volume_create_manager' (6cefb6b0-a288-471b-bbbf-1562818b745b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52982cd4-5feb-43ee-8df8-ce4b83be2bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:09 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358" returned: 0 in 1.526s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] <== create_volume: return (4164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.172s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52982cd4-5feb-43ee-8df8-ce4b83be2bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1423348098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc38de7-1235-458c-85cd-917eeb8fd081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5042b7bfbb2e4c99b56685ccac52ba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:10Z,use_quota=True,user_id='7c46e9ab62bb4df9a1f5bca9b2f68a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44581347-5236-4873-9b1c-f901a9314b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44581347-5236-4873-9b1c-f901a9314b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2585adb5-c84c-4d35-a614-64f9695d9fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2585adb5-c84c-4d35-a614-64f9695d9fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc38de7-1235-458c-85cd-917eeb8fd081', 'volume_name': 'volume-4bc38de7-1235-458c-85cd-917eeb8fd081', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5452d6a4-79e3-49f2-9fa8-ff4f095b6bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5452d6a4-79e3-49f2-9fa8-ff4f095b6bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ae144a-5129-464d-8662-4971ec639909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Volume 4bc38de7-1235-458c-85cd-917eeb8fd081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc38de7-1235-458c-85cd-917eeb8fd081', 'volume_size': 1} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1423348098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc38de7-1235-458c-85cd-917eeb8fd081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5042b7bfbb2e4c99b56685ccac52ba49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:10Z,use_quota=True,user_id='7c46e9ab62bb4df9a1f5bca9b2f68a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Creating volume 4bc38de7-1235-458c-85cd-917eeb8fd081 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:10 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:09:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:10 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081 1073741824 Jul 06 12:09:10 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ac6df99-f628-44fb-870a-4119879d49a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249acc4d-59bd-4661-87d3-27f62ba74358', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4cd295-83db-4960-a15f-79841e0e39ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:10 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Volume volume-249acc4d-59bd-4661-87d3-27f62ba74358 (249acc4d-59bd-4661-87d3-27f62ba74358): created successfully Jul 06 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4cd295-83db-4960-a15f-79841e0e39ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Flow 'volume_create_manager' (9cb323c2-ed8c-420e-9b8c-905549128940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-da3aa46e-5fe5-45a8-ac9a-bd9e86d8db02 tempest-DeleteServersTestJSON-378517084 None] Created volume successfully. Jul 06 12:09:11 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081 1073741824" returned: 0 in 1.598s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:11 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081 Jul 06 12:09:11 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:12 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081" returned: 0 in 1.312s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] <== create_volume: return (3010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ae144a-5129-464d-8662-4971ec639909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc38de7-1235-458c-85cd-917eeb8fd081', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cddcc0f-b5ac-4e9f-b10f-e72a82152a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:13 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Volume volume-4bc38de7-1235-458c-85cd-917eeb8fd081 (4bc38de7-1235-458c-85cd-917eeb8fd081): created successfully Jul 06 12:09:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cddcc0f-b5ac-4e9f-b10f-e72a82152a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Flow 'volume_create_manager' (6cefb6b0-a288-471b-bbbf-1562818b745b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fc3ef0ee-6d5f-42c5-ba2d-86163f2f9628 tempest-VolumesAdminNegativeTest-1949961968 None] Created volume successfully. Jul 06 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Acquiring lock "cinder-4bc38de7-1235-458c-85cd-917eeb8fd081-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Lock "cinder-4bc38de7-1235-458c-85cd-917eeb8fd081-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Acquiring lock "cinder-quobyte-4bc38de7-1235-458c-85cd-917eeb8fd081" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Lock "cinder-quobyte-4bc38de7-1235-458c-85cd-917eeb8fd081" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:15 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqextx5yi/privsep.sock'] Jul 06 12:09:15 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqextx5yi/privsep.sock Jul 06 12:09:15 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:16 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 06 12:09:16 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:09:16 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 12:09:16 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:09:16 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:09:16 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 12:09:16 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:09:16 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:09:16 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 06 12:09:18 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 06 12:09:18 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 12:09:18 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 12:09:18 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:09:18 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 12:09:18 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 12:09:18 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 12:09:18 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 12:09:18 devstack cinder-volume[86561]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 06 12:09:18 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:18 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Spawned new privsep daemon via rootwrap Jul 06 12:09:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Accepted privsep connection to /tmp/tmpqextx5yi/privsep.sock {{(pid=86561) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 06 12:09:18 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 06 12:09:18 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 06 12:09:18 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 06 12:09:18 devstack cinder-volume[86561]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87828 Jul 06 12:09:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8008ff-d8a2-46d6-a333-b2922b4bf661]: (2,) {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[264aadbf-574e-403f-ad84-b89eb36fd10d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:18 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081 Jul 06 12:09:18 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:20 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:20 devstack cinder-volume[86561]: WARNING py.warnings [req-cd22afb5-00f4-49fe-9c2d-4d34fc071ff7 req-0c198b5f-837f-4a5f-9cac-c751caa78105 tempest-DeleteServersTestJSON-378517084 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 06 12:09:20 devstack cinder-volume[86561]: .first() Jul 06 12:09:20 devstack cinder-volume[86561]: Jul 06 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081" returned: 0 in 1.925s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:20 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081 Jul 06 12:09:20 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-cd22afb5-00f4-49fe-9c2d-4d34fc071ff7 req-0c198b5f-837f-4a5f-9cac-c751caa78105 tempest-DeleteServersTestJSON-378517084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-cd22afb5-00f4-49fe-9c2d-4d34fc071ff7 req-0c198b5f-837f-4a5f-9cac-c751caa78105 tempest-DeleteServersTestJSON-378517084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de839cd-3c97-42b7-a8e7-21ad80ab91c9]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-cd22afb5-00f4-49fe-9c2d-4d34fc071ff7 req-0c198b5f-837f-4a5f-9cac-c751caa78105 tempest-DeleteServersTestJSON-378517084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:21 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358 Jul 06 12:09:21 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:21 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4bc38de7-1235-458c-85cd-917eeb8fd081" returned: 0 in 1.201s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Lock "cinder-quobyte-4bc38de7-1235-458c-85cd-917eeb8fd081" released by "delete_volume" :: held 6.181s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:22 devstack cinder-volume[86561]: WARNING cinder.quota [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:09:22 devstack cinder-volume[86561]: WARNING cinder.quota [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:09:22 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Created reservations ['b9215886-e92e-41e3-a704-2de9f47ad17c', '7184bd08-d167-49cb-a6f1-7256b0ed71df', 'c73af659-535d-4e8c-b9e2-f1077288845a', '0be29b4a-9481-453d-8207-44c511a5a145'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:22 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:09:22 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:22 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-cd22afb5-00f4-49fe-9c2d-4d34fc071ff7 req-0c198b5f-837f-4a5f-9cac-c751caa78105 tempest-DeleteServersTestJSON-378517084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358" returned: 0 in 1.673s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-cd22afb5-00f4-49fe-9c2d-4d34fc071ff7 req-0c198b5f-837f-4a5f-9cac-c751caa78105 tempest-DeleteServersTestJSON-378517084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.700s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-cd22afb5-00f4-49fe-9c2d-4d34fc071ff7 req-0c198b5f-837f-4a5f-9cac-c751caa78105 tempest-DeleteServersTestJSON-378517084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-249acc4d-59bd-4661-87d3-27f62ba74358', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97fd7d54-f481-4a2d-8383-1c7ffcd283ae', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:09:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-cd22afb5-00f4-49fe-9c2d-4d34fc071ff7 req-0c198b5f-837f-4a5f-9cac-c751caa78105 tempest-DeleteServersTestJSON-378517084 None] attachment_update completed successfully. Jul 06 12:09:23 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.256s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:23 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Deleted volume successfully. Jul 06 12:09:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc9aad92-6468-493f-9949-eb21f098bc8f tempest-VolumesAdminNegativeTest-1949961968 None] Lock "cinder-4bc38de7-1235-458c-85cd-917eeb8fd081-delete_volume" released by "delete_volume" :: held 7.949s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Flow 'volume_create_manager' (59ac80d9-1edb-40b2-98eb-139cfa428c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aadf6a8-3492-4a56-925f-a8f3fac586e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aadf6a8-3492-4a56-925f-a8f3fac586e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1253543836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28332939-7ec3-4dd1-9708-3a8adfe2f34b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba68697756dd4c8d8bd6f377e3c931a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:24Z,use_quota=True,user_id='7981534f2ff846dd90cd15965877c62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf010e6-6743-4c42-bcf1-392fbc47bcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf010e6-6743-4c42-bcf1-392fbc47bcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd20418b-863a-4b34-a1ca-23ad3f94ba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd20418b-863a-4b34-a1ca-23ad3f94ba5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28332939-7ec3-4dd1-9708-3a8adfe2f34b', 'volume_name': 'volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa16687a-dd3e-4285-800f-115824049e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa16687a-dd3e-4285-800f-115824049e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39ed3f5-e3a4-45aa-8ec9-d465bcdc3037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:24 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Volume 28332939-7ec3-4dd1-9708-3a8adfe2f34b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b', 'volume_size': 1} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1253543836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28332939-7ec3-4dd1-9708-3a8adfe2f34b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba68697756dd4c8d8bd6f377e3c931a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:24Z,use_quota=True,user_id='7981534f2ff846dd90cd15965877c62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Creating volume 28332939-7ec3-4dd1-9708-3a8adfe2f34b {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:24 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:09:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:24 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b 1073741824 Jul 06 12:09:24 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:26 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b 1073741824" returned: 0 in 1.654s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:26 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b Jul 06 12:09:26 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:27 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b" returned: 0 in 1.028s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] <== create_volume: return (2809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.811s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39ed3f5-e3a4-45aa-8ec9-d465bcdc3037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005156f9-6a21-4f38-ac8b-efffeadaf712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Volume volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b (28332939-7ec3-4dd1-9708-3a8adfe2f34b): created successfully Jul 06 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005156f9-6a21-4f38-ac8b-efffeadaf712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Flow 'volume_create_manager' (59ac80d9-1edb-40b2-98eb-139cfa428c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-331e6e92-3b15-4864-bb67-b322ac0163c6 tempest-ServerActionsTestOtherA-1558512385 None] Created volume successfully. Jul 06 12:09:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:09:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:32 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:09:32 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:34 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.322s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:34 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:09:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 8 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:09:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:09:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-6aad3c3a-311e-4857-8e74-e0017c5c2258 req-99bb8e93-fe3e-4df0-aad3-bc01bae9b4f4 tempest-DeleteServersTestJSON-378517084 None] Terminate volume connection completed successfully. Jul 06 12:09:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-6aad3c3a-311e-4857-8e74-e0017c5c2258 req-99bb8e93-fe3e-4df0-aad3-bc01bae9b4f4 tempest-DeleteServersTestJSON-378517084 None] Deleting attachment 97fd7d54-f481-4a2d-8383-1c7ffcd283ae. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Acquiring lock "cinder-249acc4d-59bd-4661-87d3-27f62ba74358-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Lock "cinder-249acc4d-59bd-4661-87d3-27f62ba74358-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Acquiring lock "cinder-quobyte-249acc4d-59bd-4661-87d3-27f62ba74358" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:09:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Lock "cinder-quobyte-249acc4d-59bd-4661-87d3-27f62ba74358" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:09:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0909533f-3db0-4172-9c72-3e0823e0f387]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:09:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:42 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358 Jul 06 12:09:42 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:43 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358" returned: 0 in 1.077s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:43 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358 Jul 06 12:09:43 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:44 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-249acc4d-59bd-4661-87d3-27f62ba74358" returned: 0 in 0.896s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Lock "cinder-quobyte-249acc4d-59bd-4661-87d3-27f62ba74358" released by "delete_volume" :: held 2.054s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:44 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Created reservations ['39118208-d8df-4e75-a3d5-b18c116589c7', 'f5b86038-6bde-47c9-8b0e-362fb30d5cd8', '50004e63-50ed-4d56-ad60-5a578b3b8d45', 'fa91f656-882b-436f-bfa1-388adb61e192'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:09:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:44 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:09:44 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:45 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.868s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:45 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:09:45 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Deleted volume successfully. Jul 06 12:09:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ef90c304-e602-4241-8ecb-db4ffdd9df7a tempest-DeleteServersTestJSON-378517084 None] Lock "cinder-249acc4d-59bd-4661-87d3-27f62ba74358-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Flow 'volume_create_manager' (5eed79ba-91f3-4833-97fa-0271d16eea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde65fad-3802-4a03-8f36-90c8e4275035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde65fad-3802-4a03-8f36-90c8e4275035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-786235070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a817c1-976b-484a-8f5e-b912f357b1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3660fc080e54666b1b662039397ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:54Z,use_quota=True,user_id='ef8677637e504477ad357afeba0c6874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0984c873-e814-437d-8fea-8109215ec304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0984c873-e814-437d-8fea-8109215ec304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cb7c3d-b5c4-4e28-a624-38f60d5462e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9cb7c3d-b5c4-4e28-a624-38f60d5462e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a817c1-976b-484a-8f5e-b912f357b1bb', 'volume_name': 'volume-67a817c1-976b-484a-8f5e-b912f357b1bb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39dffda-90f6-4f1b-94ed-577c613cb528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39dffda-90f6-4f1b-94ed-577c613cb528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2d96f8-2b19-421c-baea-cd9592a18fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:54 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Volume 67a817c1-976b-484a-8f5e-b912f357b1bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a817c1-976b-484a-8f5e-b912f357b1bb', 'volume_size': 1} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-786235070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a817c1-976b-484a-8f5e-b912f357b1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3660fc080e54666b1b662039397ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:09:54Z,use_quota=True,user_id='ef8677637e504477ad357afeba0c6874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Creating volume 67a817c1-976b-484a-8f5e-b912f357b1bb {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:09:54 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:09:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:54 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb 1073741824 Jul 06 12:09:54 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:56 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb 1073741824" returned: 0 in 1.447s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:09:56 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb Jul 06 12:09:56 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:09:57 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Jul 06 12:09:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb" returned: 0 in 1.060s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:09:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] <== create_volume: return (2585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:09:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.588s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:09:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2d96f8-2b19-421c-baea-cd9592a18fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a817c1-976b-484a-8f5e-b912f357b1bb', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de87366-716e-44cb-9367-13b022de109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:09:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Volume volume-67a817c1-976b-484a-8f5e-b912f357b1bb (67a817c1-976b-484a-8f5e-b912f357b1bb): created successfully Jul 06 12:09:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de87366-716e-44cb-9367-13b022de109d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:09:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Flow 'volume_create_manager' (5eed79ba-91f3-4833-97fa-0271d16eea3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:09:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8e8b9936-3ae6-4c75-a4bf-ff21fa75eb99 tempest-TaggedAttachmentsTest-1415168122 None] Created volume successfully. Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=25,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Flow 'volume_create_manager' (4bfc0b6a-88e1-478d-91cd-4833b8530a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4417203-1407-4777-9baa-72d7a9f7d44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4417203-1407-4777-9baa-72d7a9f7d44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-971816153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c62ae90-2ad0-4906-9447-652ed6129068,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba42c5eb32334ca589b184456e9e1edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:00Z,use_quota=True,user_id='99a8093b3efc4ea38d1c5de3fa0aac24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a447685-6a60-4a24-afe8-85d62bc2acbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a447685-6a60-4a24-afe8-85d62bc2acbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ec9f15-4b3d-42e0-9f95-ea102fbe40ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ec9f15-4b3d-42e0-9f95-ea102fbe40ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c62ae90-2ad0-4906-9447-652ed6129068', 'volume_name': 'volume-3c62ae90-2ad0-4906-9447-652ed6129068', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387e4c25-3ae7-4fb0-ab6a-740ad60a2bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387e4c25-3ae7-4fb0-ab6a-740ad60a2bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d77e14-2648-4332-b2b5-f634651b7c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:00 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Volume 3c62ae90-2ad0-4906-9447-652ed6129068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c62ae90-2ad0-4906-9447-652ed6129068', 'volume_size': 1} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-971816153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c62ae90-2ad0-4906-9447-652ed6129068,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba42c5eb32334ca589b184456e9e1edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:00Z,use_quota=True,user_id='99a8093b3efc4ea38d1c5de3fa0aac24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Creating volume 3c62ae90-2ad0-4906-9447-652ed6129068 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:00 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:10:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:00 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068 1073741824 Jul 06 12:10:00 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:02 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068 1073741824" returned: 0 in 1.682s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:02 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068 Jul 06 12:10:02 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:03 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068" returned: 0 in 1.183s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] <== create_volume: return (2997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d77e14-2648-4332-b2b5-f634651b7c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c62ae90-2ad0-4906-9447-652ed6129068', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4ac705-d4a3-43fa-94db-48e019cb2a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:03 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Volume volume-3c62ae90-2ad0-4906-9447-652ed6129068 (3c62ae90-2ad0-4906-9447-652ed6129068): created successfully Jul 06 12:10:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4ac705-d4a3-43fa-94db-48e019cb2a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Flow 'volume_create_manager' (4bfc0b6a-88e1-478d-91cd-4833b8530a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-11722dc8-0651-4a9b-82e0-d2afa1092339 tempest-VolumesTestJSON-853216790 None] Created volume successfully. Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Flow 'volume_create_manager' (f1f8b28d-02c2-4aef-9e51-08ad002f6cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b384cfd-634d-45d5-bd30-0367e23607f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b384cfd-634d-45d5-bd30-0367e23607f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-440502455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba42c5eb32334ca589b184456e9e1edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:06Z,use_quota=True,user_id='99a8093b3efc4ea38d1c5de3fa0aac24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9b05c7-62e2-4167-9da0-399e41cd578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9b05c7-62e2-4167-9da0-399e41cd578a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96851453-4ecb-48cb-afe3-1eb280c7cd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96851453-4ecb-48cb-afe3-1eb280c7cd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f1c1d6-2e64-4ff9-8d35-d752d2d5775f', 'volume_name': 'volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1b239a-c4f3-4dbb-9360-561e4984f919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1b239a-c4f3-4dbb-9360-561e4984f919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06eb3ee2-9ee3-4809-8966-e8bd006424db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Volume d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f', 'volume_size': 1} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-440502455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba42c5eb32334ca589b184456e9e1edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:06Z,use_quota=True,user_id='99a8093b3efc4ea38d1c5de3fa0aac24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Creating volume d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:06 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:10:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:06 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f 1073741824 Jul 06 12:10:06 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:08 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f 1073741824" returned: 0 in 1.777s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:08 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f Jul 06 12:10:08 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:09 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f" returned: 0 in 0.877s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] <== create_volume: return (2731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.742s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06eb3ee2-9ee3-4809-8966-e8bd006424db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c793dd-daed-4579-a040-2a4a4d51b8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Volume volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f (d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f): created successfully Jul 06 12:10:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c793dd-daed-4579-a040-2a4a4d51b8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Flow 'volume_create_manager' (f1f8b28d-02c2-4aef-9e51-08ad002f6cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-beac895f-e60d-42af-8ad2-aa92532968cf tempest-VolumesTestJSON-853216790 None] Created volume successfully. Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Flow 'volume_create_manager' (ffc486b8-935d-4f66-bb8a-bdcb34b19e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1d3cb7-ebf6-471b-a7a5-021da5227bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1d3cb7-ebf6-471b-a7a5-021da5227bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1548175890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbb464b-0eeb-488a-a6d4-5ff6bd59a487,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba42c5eb32334ca589b184456e9e1edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:12Z,use_quota=True,user_id='99a8093b3efc4ea38d1c5de3fa0aac24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9011378d-faa8-4c3c-b3bc-cddd5ce7329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9011378d-faa8-4c3c-b3bc-cddd5ce7329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ea5159-c4ab-4841-9d25-c0f5fb206826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ea5159-c4ab-4841-9d25-c0f5fb206826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffbb464b-0eeb-488a-a6d4-5ff6bd59a487', 'volume_name': 'volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b697b262-5629-407c-97ed-6e9b35c3d03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b697b262-5629-407c-97ed-6e9b35c3d03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d63b30-aea4-4a61-a9ea-e654a278ea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:11 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Volume ffbb464b-0eeb-488a-a6d4-5ff6bd59a487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487', 'volume_size': 1} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1548175890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbb464b-0eeb-488a-a6d4-5ff6bd59a487,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba42c5eb32334ca589b184456e9e1edc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:10:12Z,use_quota=True,user_id='99a8093b3efc4ea38d1c5de3fa0aac24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Creating volume ffbb464b-0eeb-488a-a6d4-5ff6bd59a487 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:10:11 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:10:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:11 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487 1073741824 Jul 06 12:10:11 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:12 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487 1073741824" returned: 0 in 1.190s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:13 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487 Jul 06 12:10:13 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:14 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487" returned: 0 in 1.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] <== create_volume: return (2494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:10:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.497s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d63b30-aea4-4a61-a9ea-e654a278ea10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8703674-1bbb-403b-9860-541a40ffaf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:10:14 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Volume volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487 (ffbb464b-0eeb-488a-a6d4-5ff6bd59a487): created successfully Jul 06 12:10:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8703674-1bbb-403b-9860-541a40ffaf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:10:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Flow 'volume_create_manager' (ffc486b8-935d-4f66-bb8a-bdcb34b19e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:10:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-aa735eab-64ea-4cef-a60a-4f1baab6ebbf tempest-VolumesTestJSON-853216790 None] Created volume successfully. Jul 06 12:10:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Acquiring lock "cinder-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Lock "cinder-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Acquiring lock "cinder-quobyte-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Lock "cinder-quobyte-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:16 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f4f156-31e7-4d7c-a3e0-00d3561c79cc]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:17 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487 Jul 06 12:10:17 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:18 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487" returned: 0 in 1.302s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:18 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487 Jul 06 12:10:18 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:19 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487" returned: 0 in 1.207s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Lock "cinder-quobyte-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487" released by "delete_volume" :: held 2.572s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:19 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Created reservations ['a67f4ca1-4804-4c42-aece-9f03d89bbed6', '33013b72-1bf7-4a33-a7c5-dc70db5f0255', 'f45f9197-b79c-40ad-8f16-4021e092403e', 'c36317eb-18cc-4b55-8c07-e43cf191001c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:19 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:10:19 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Acquiring lock "cinder-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Lock "cinder-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Acquiring lock "cinder-quobyte-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Lock "cinder-quobyte-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f" acquired by "delete_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a45bac6-9997-4a8c-9eb6-5fb2d1a8f0d2]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:21 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f Jul 06 12:10:21 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:21 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.650s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:21 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Deleted volume successfully. Jul 06 12:10:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-698b85d6-605d-4e85-8ae8-d546c2b44285 tempest-VolumesTestJSON-853216790 None] Lock "cinder-ffbb464b-0eeb-488a-a6d4-5ff6bd59a487-delete_volume" released by "delete_volume" :: held 4.643s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:22 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f" returned: 0 in 1.401s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:22 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f Jul 06 12:10:22 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:23 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f" returned: 0 in 1.462s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Lock "cinder-quobyte-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f" released by "delete_volume" :: held 2.981s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:23 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Created reservations ['6d9a72f0-fd55-48ff-b36e-3fa577eb3824', '03860c87-a58e-4c69-9227-9dc766235d92', 'e44a38d0-0ea8-458f-816c-8098647a9810', '04f15458-6c92-4433-9eb5-1134483c4a02'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:24 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:10:24 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Acquiring lock "cinder-3c62ae90-2ad0-4906-9447-652ed6129068-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Lock "cinder-3c62ae90-2ad0-4906-9447-652ed6129068-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Acquiring lock "cinder-quobyte-3c62ae90-2ad0-4906-9447-652ed6129068" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Lock "cinder-quobyte-3c62ae90-2ad0-4906-9447-652ed6129068" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdea2927-3a74-4cc0-8bb8-ae36b7037198]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:24 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068 Jul 06 12:10:24 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:25 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.453s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Deleted volume successfully. Jul 06 12:10:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-69a7314b-aa7e-45a1-b163-e6ecba4db3f8 tempest-VolumesTestJSON-853216790 None] Lock "cinder-d8f1c1d6-2e64-4ff9-8d35-d752d2d5775f-delete_volume" released by "delete_volume" :: held 4.930s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:26 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068" returned: 0 in 1.433s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:26 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068 Jul 06 12:10:26 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:27 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3c62ae90-2ad0-4906-9447-652ed6129068" returned: 0 in 1.639s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Lock "cinder-quobyte-3c62ae90-2ad0-4906-9447-652ed6129068" released by "delete_volume" :: held 3.160s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:27 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Created reservations ['04c02fd4-4da3-4cc7-a2a3-b25dd2ef37ff', '80296e73-94ff-4571-89a5-ef1af347962e', 'fc54b17f-4c8c-478c-88d7-2545018e10fd', '6fe259ef-6632-480c-98c3-21b1b0213fdf'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:10:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:28 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:10:28 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:29 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.273s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:29 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Deleted volume successfully. Jul 06 12:10:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-873a0ac3-5a6b-448d-b85c-cf67c74af766 tempest-VolumesTestJSON-853216790 None] Lock "cinder-3c62ae90-2ad0-4906-9447-652ed6129068-delete_volume" released by "delete_volume" :: held 4.826s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-51a782c4-c707-4959-b453-25300378cefe req-0cfb44f5-9070-48f0-914e-4ed53490ce82 tempest-ServerActionsTestOtherA-1558512385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-51a782c4-c707-4959-b453-25300378cefe req-0cfb44f5-9070-48f0-914e-4ed53490ce82 tempest-ServerActionsTestOtherA-1558512385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[41994193-2df3-4f3a-92c1-936eaa011195]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-51a782c4-c707-4959-b453-25300378cefe req-0cfb44f5-9070-48f0-914e-4ed53490ce82 tempest-ServerActionsTestOtherA-1558512385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:32 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b Jul 06 12:10:32 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:10:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:32 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:10:32 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:33 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-51a782c4-c707-4959-b453-25300378cefe req-0cfb44f5-9070-48f0-914e-4ed53490ce82 tempest-ServerActionsTestOtherA-1558512385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b" returned: 0 in 1.237s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-51a782c4-c707-4959-b453-25300378cefe req-0cfb44f5-9070-48f0-914e-4ed53490ce82 tempest-ServerActionsTestOtherA-1558512385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.284s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-51a782c4-c707-4959-b453-25300378cefe req-0cfb44f5-9070-48f0-914e-4ed53490ce82 tempest-ServerActionsTestOtherA-1558512385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2970ce13-f385-46bc-a16e-f5e254502c7f', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:10:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-51a782c4-c707-4959-b453-25300378cefe req-0cfb44f5-9070-48f0-914e-4ed53490ce82 tempest-ServerActionsTestOtherA-1558512385 None] attachment_update completed successfully. Jul 06 12:10:34 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.576s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:10:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-5276479c-7a94-485d-a310-92237c306590 req-4a055cde-e0a3-465c-b19a-928a0aad1352 tempest-ServerActionsTestOtherA-1558512385 None] Terminate volume connection completed successfully. Jul 06 12:10:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-5276479c-7a94-485d-a310-92237c306590 req-4a055cde-e0a3-465c-b19a-928a0aad1352 tempest-ServerActionsTestOtherA-1558512385 None] Deleting attachment 2970ce13-f385-46bc-a16e-f5e254502c7f. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:10:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-5276479c-7a94-485d-a310-92237c306590 req-0e39a795-7f19-41b9-94b0-ab7709ed91d2 tempest-ServerActionsTestOtherA-1558512385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:10:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-5276479c-7a94-485d-a310-92237c306590 req-0e39a795-7f19-41b9-94b0-ab7709ed91d2 tempest-ServerActionsTestOtherA-1558512385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:10:46 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a40bfe-19b6-4e53-ad39-9f210a200648]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:10:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-5276479c-7a94-485d-a310-92237c306590 req-0e39a795-7f19-41b9-94b0-ab7709ed91d2 tempest-ServerActionsTestOtherA-1558512385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:10:46 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b Jul 06 12:10:46 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:10:47 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Jul 06 12:10:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-5276479c-7a94-485d-a310-92237c306590 req-0e39a795-7f19-41b9-94b0-ab7709ed91d2 tempest-ServerActionsTestOtherA-1558512385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b" returned: 0 in 1.171s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:10:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-5276479c-7a94-485d-a310-92237c306590 req-0e39a795-7f19-41b9-94b0-ab7709ed91d2 tempest-ServerActionsTestOtherA-1558512385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.193s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:10:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-5276479c-7a94-485d-a310-92237c306590 req-0e39a795-7f19-41b9-94b0-ab7709ed91d2 tempest-ServerActionsTestOtherA-1558512385 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca0d864c-0038-4e5a-ba18-2b1b370207b3', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:10:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-5276479c-7a94-485d-a310-92237c306590 req-0e39a795-7f19-41b9-94b0-ab7709ed91d2 tempest-ServerActionsTestOtherA-1558512385 None] attachment_update completed successfully. Jul 06 12:10:57 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=32,cinder:UPDATE=36,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:10:57 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=33,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Flow 'volume_create_manager' (7cd75474-61f4-4ea1-a2c2-119b368b9e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef13c5b1-f36d-4237-ad62-f848cef1ca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef13c5b1-f36d-4237-ad62-f848cef1ca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1980604968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7b082e-c8f6-437e-a396-d64f4484cb1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b733bf5e5b4954beb5518adcdbbe2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:11Z,use_quota=True,user_id='30fa403e89244c78b1e5274683031a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71efdea-cc80-46ac-acc6-5bf0f6017b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71efdea-cc80-46ac-acc6-5bf0f6017b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca373d1-ca25-4aab-9128-aae9f1d0ebdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca373d1-ca25-4aab-9128-aae9f1d0ebdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c7b082e-c8f6-437e-a396-d64f4484cb1b', 'volume_name': 'volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068e2356-56c1-41b7-9f37-ea73ce460cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068e2356-56c1-41b7-9f37-ea73ce460cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fe4a56-17dc-4624-9406-f9ed011f209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:11 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Volume 9c7b082e-c8f6-437e-a396-d64f4484cb1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b', 'volume_size': 1} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1980604968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7b082e-c8f6-437e-a396-d64f4484cb1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b733bf5e5b4954beb5518adcdbbe2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:11Z,use_quota=True,user_id='30fa403e89244c78b1e5274683031a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Creating volume 9c7b082e-c8f6-437e-a396-d64f4484cb1b {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:11 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:11:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:11 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b 1073741824 Jul 06 12:11:11 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-2b739d82-f7fa-45a7-ae06-1a1d6338d953 req-8f3a106b-25fa-4847-85ad-bb85ef17e0d1 tempest-TaggedAttachmentsTest-1415168122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:13 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b 1073741824" returned: 0 in 1.530s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:13 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b Jul 06 12:11:13 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:13 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b" returned: 0 in 0.840s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] <== create_volume: return (2417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.423s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-2b739d82-f7fa-45a7-ae06-1a1d6338d953 req-8f3a106b-25fa-4847-85ad-bb85ef17e0d1 tempest-TaggedAttachmentsTest-1415168122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.103s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fe4a56-17dc-4624-9406-f9ed011f209e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51289d8e-d8cb-4d64-b227-ea28e874ebcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b069b8f-9124-4381-be3f-d2f81504af7d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-2b739d82-f7fa-45a7-ae06-1a1d6338d953 req-8f3a106b-25fa-4847-85ad-bb85ef17e0d1 tempest-TaggedAttachmentsTest-1415168122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:14 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Volume volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b (9c7b082e-c8f6-437e-a396-d64f4484cb1b): created successfully Jul 06 12:11:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51289d8e-d8cb-4d64-b227-ea28e874ebcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Flow 'volume_create_manager' (7cd75474-61f4-4ea1-a2c2-119b368b9e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-938fabe8-c0cc-4698-bc1e-d349d88f9458 tempest-VolumeQuotasAdminTestJSON-433225915 None] Created volume successfully. Jul 06 12:11:14 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb Jul 06 12:11:14 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Acquiring lock "cinder-9c7b082e-c8f6-437e-a396-d64f4484cb1b-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "cinder-9c7b082e-c8f6-437e-a396-d64f4484cb1b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Acquiring lock "cinder-quobyte-9c7b082e-c8f6-437e-a396-d64f4484cb1b" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "cinder-quobyte-9c7b082e-c8f6-437e-a396-d64f4484cb1b" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:14 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0df265f-843d-4b71-8196-5ddfa17c18c7]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:15 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b Jul 06 12:11:15 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:15 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-2b739d82-f7fa-45a7-ae06-1a1d6338d953 req-8f3a106b-25fa-4847-85ad-bb85ef17e0d1 tempest-TaggedAttachmentsTest-1415168122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb" returned: 0 in 1.180s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-2b739d82-f7fa-45a7-ae06-1a1d6338d953 req-8f3a106b-25fa-4847-85ad-bb85ef17e0d1 tempest-TaggedAttachmentsTest-1415168122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.224s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2b739d82-f7fa-45a7-ae06-1a1d6338d953 req-8f3a106b-25fa-4847-85ad-bb85ef17e0d1 tempest-TaggedAttachmentsTest-1415168122 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-67a817c1-976b-484a-8f5e-b912f357b1bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e397821b-0e0a-401d-886e-f5470f964741', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:11:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-2b739d82-f7fa-45a7-ae06-1a1d6338d953 req-8f3a106b-25fa-4847-85ad-bb85ef17e0d1 tempest-TaggedAttachmentsTest-1415168122 None] attachment_update completed successfully. Jul 06 12:11:15 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b" returned: 0 in 0.976s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:15 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b Jul 06 12:11:15 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:16 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9c7b082e-c8f6-437e-a396-d64f4484cb1b" returned: 0 in 0.750s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "cinder-quobyte-9c7b082e-c8f6-437e-a396-d64f4484cb1b" released by "delete_volume" :: held 1.783s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:16 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Created reservations ['3f1366bb-e6d4-46a8-b712-daad31933255', '75d3cf63-60d5-4cc1-a71f-8d5892ab95fe', 'cadc71fe-1ec3-4837-af10-16fb983d86f2', 'a9ddd5e8-8f92-45b0-b676-5a13060d5d63'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:16 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:11:16 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:17 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.810s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Deleted volume successfully. Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Flow 'volume_create_manager' (1f6c7842-3825-43f5-93aa-81a3ded1db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b4f563-26d8-4525-88c7-f06a3056f010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e233782-2ea2-4019-9569-687700a959c9 tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "cinder-9c7b082e-c8f6-437e-a396-d64f4484cb1b-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b4f563-26d8-4525-88c7-f06a3056f010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1444127555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b46f59-7cfb-437e-86dc-a45e981574d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b733bf5e5b4954beb5518adcdbbe2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:18Z,use_quota=True,user_id='30fa403e89244c78b1e5274683031a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac81822-ecd0-4203-a788-79b0848678fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac81822-ecd0-4203-a788-79b0848678fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e9c7b9-5914-41a5-bdad-6df509e74dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e9c7b9-5914-41a5-bdad-6df509e74dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94b46f59-7cfb-437e-86dc-a45e981574d3', 'volume_name': 'volume-94b46f59-7cfb-437e-86dc-a45e981574d3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946feff0-36a3-418f-b7bc-b86dd44c5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946feff0-36a3-418f-b7bc-b86dd44c5088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3f2845-f1d4-4b22-ab85-36330c6afb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:17 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Volume 94b46f59-7cfb-437e-86dc-a45e981574d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94b46f59-7cfb-437e-86dc-a45e981574d3', 'volume_size': 1} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1444127555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b46f59-7cfb-437e-86dc-a45e981574d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b733bf5e5b4954beb5518adcdbbe2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:18Z,use_quota=True,user_id='30fa403e89244c78b1e5274683031a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Creating volume 94b46f59-7cfb-437e-86dc-a45e981574d3 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:17 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:11:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:17 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3 1073741824 Jul 06 12:11:17 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:18 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3 1073741824" returned: 0 in 0.963s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:18 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3 Jul 06 12:11:18 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:19 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3" returned: 0 in 0.743s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3f2845-f1d4-4b22-ab85-36330c6afb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b46f59-7cfb-437e-86dc-a45e981574d3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e58c3e9-c060-462b-b827-f52ac6d9e80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:19 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Volume volume-94b46f59-7cfb-437e-86dc-a45e981574d3 (94b46f59-7cfb-437e-86dc-a45e981574d3): created successfully Jul 06 12:11:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e58c3e9-c060-462b-b827-f52ac6d9e80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Flow 'volume_create_manager' (1f6c7842-3825-43f5-93aa-81a3ded1db0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9282caa7-2ab7-45c2-9351-a7386ec85a5b tempest-VolumeQuotasAdminTestJSON-433225915 None] Created volume successfully. Jul 06 12:11:20 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a65e39d3-051d-49ea-8521-90800c64a225 tempest-VolumeQuotasAdminTestJSON-958268790 None] Transfer volume completed successfully. Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Flow 'volume_create_manager' (6a334360-0482-4e10-a041-2dfa1078522b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52da4755-417e-4551-a138-113c453b7090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52da4755-417e-4551-a138-113c453b7090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1240841201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a68a6a-7fa8-4ecf-b172-053068759b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc5bb96eacd40d7ae8570ef5472653e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:21Z,use_quota=True,user_id='2259a871c77f49a19d266d66cbefed2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d30788-4bbf-411d-9da9-092284537a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d30788-4bbf-411d-9da9-092284537a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c3c3fe-a360-4d1d-87cb-21db3a81acf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c3c3fe-a360-4d1d-87cb-21db3a81acf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a68a6a-7fa8-4ecf-b172-053068759b44', 'volume_name': 'volume-c8a68a6a-7fa8-4ecf-b172-053068759b44', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef042a3-c173-4d82-98fa-0ff948286930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef042a3-c173-4d82-98fa-0ff948286930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e915f816-b780-42ad-b482-8eda8e1c9a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Volume c8a68a6a-7fa8-4ecf-b172-053068759b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a68a6a-7fa8-4ecf-b172-053068759b44', 'volume_size': 1} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1240841201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a68a6a-7fa8-4ecf-b172-053068759b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc5bb96eacd40d7ae8570ef5472653e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:21Z,use_quota=True,user_id='2259a871c77f49a19d266d66cbefed2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Creating volume c8a68a6a-7fa8-4ecf-b172-053068759b44 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:21 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:21 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44 1073741824 Jul 06 12:11:21 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Acquiring lock "cinder-94b46f59-7cfb-437e-86dc-a45e981574d3-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Lock "cinder-94b46f59-7cfb-437e-86dc-a45e981574d3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Acquiring lock "cinder-quobyte-94b46f59-7cfb-437e-86dc-a45e981574d3" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Lock "cinder-quobyte-94b46f59-7cfb-437e-86dc-a45e981574d3" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7e192c-588e-4c7f-8c1a-ead615c24ead]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:22 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3 Jul 06 12:11:22 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:22 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44 1073741824" returned: 0 in 1.016s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:22 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44 Jul 06 12:11:22 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-d8ac2005-4bdc-4ce0-8229-a37f5187fd1c req-4498285e-d962-4bec-9b88-d236ab48b058 tempest-TaggedAttachmentsTest-1415168122 None] Terminate volume connection completed successfully. Jul 06 12:11:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-d8ac2005-4bdc-4ce0-8229-a37f5187fd1c req-4498285e-d962-4bec-9b88-d236ab48b058 tempest-TaggedAttachmentsTest-1415168122 None] Deleting attachment e397821b-0e0a-401d-886e-f5470f964741. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:11:22 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3" returned: 0 in 0.866s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:22 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3 Jul 06 12:11:22 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:23 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44" returned: 0 in 0.785s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e915f816-b780-42ad-b482-8eda8e1c9a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a68a6a-7fa8-4ecf-b172-053068759b44', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3497ab50-1ce3-4ac7-a85e-e3675dcc5d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Volume volume-c8a68a6a-7fa8-4ecf-b172-053068759b44 (c8a68a6a-7fa8-4ecf-b172-053068759b44): created successfully Jul 06 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3497ab50-1ce3-4ac7-a85e-e3675dcc5d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Flow 'volume_create_manager' (6a334360-0482-4e10-a041-2dfa1078522b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c01fae31-4bc1-450e-a2ac-6bee2b94c20e tempest-ServersNegativeTestJSON-1921850969 None] Created volume successfully. Jul 06 12:11:23 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-94b46f59-7cfb-437e-86dc-a45e981574d3" returned: 0 in 0.986s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Lock "cinder-quobyte-94b46f59-7cfb-437e-86dc-a45e981574d3" released by "delete_volume" :: held 1.907s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:23 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Created reservations ['d8d5c28f-0569-4be6-a00b-3ef691f88262', '7cefa0e6-c5e0-41d4-a9d7-2a03e4dfcdf7', 'cf8d3561-104c-4adc-95cb-d4e2c9da39ca', '7e31c3f5-11be-4ad2-aea2-2c6b0ac05236'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:24 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:11:24 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:24 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.870s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Deleted volume successfully. Jul 06 12:11:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a87df9a3-fab7-47a8-9a28-ea699e288038 tempest-VolumeQuotasAdminTestJSON-826664170 None] Lock "cinder-94b46f59-7cfb-437e-86dc-a45e981574d3-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-9cc8980c-9b7f-47b8-b094-9852a1c899d6 req-3aba19cb-8ecf-4ccf-a0c9-9052517f2d07 tempest-ServerActionsTestOtherA-1558512385 None] Terminate volume connection completed successfully. Jul 06 12:11:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-9cc8980c-9b7f-47b8-b094-9852a1c899d6 req-3aba19cb-8ecf-4ccf-a0c9-9052517f2d07 tempest-ServerActionsTestOtherA-1558512385 None] Deleting attachment ca0d864c-0038-4e5a-ba18-2b1b370207b3. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Flow 'volume_create_manager' (2f042762-a09b-4661-b885-e1d3d31699f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e529b9-b753-4a42-86d0-03788b7cda95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e529b9-b753-4a42-86d0-03788b7cda95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-471995247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5271496a-dbf3-49c7-b4a7-29a1cadef14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc5bb96eacd40d7ae8570ef5472653e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:26Z,use_quota=True,user_id='2259a871c77f49a19d266d66cbefed2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de91629-0688-4d2c-8342-cfb8bfcb8a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de91629-0688-4d2c-8342-cfb8bfcb8a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cf60ab-1a10-4a8e-9f00-af8621572e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36cf60ab-1a10-4a8e-9f00-af8621572e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5271496a-dbf3-49c7-b4a7-29a1cadef14f', 'volume_name': 'volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41345083-29ae-4a59-b2ac-7ac4c2ab331f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41345083-29ae-4a59-b2ac-7ac4c2ab331f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3255de4-3ba2-4f3e-905d-181c161ef6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Volume 5271496a-dbf3-49c7-b4a7-29a1cadef14f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f', 'volume_size': 1} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-471995247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5271496a-dbf3-49c7-b4a7-29a1cadef14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc5bb96eacd40d7ae8570ef5472653e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:26Z,use_quota=True,user_id='2259a871c77f49a19d266d66cbefed2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Creating volume 5271496a-dbf3-49c7-b4a7-29a1cadef14f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:26 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:11:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:26 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f 1073741824 Jul 06 12:11:26 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:27 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f 1073741824" returned: 0 in 1.225s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:27 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f Jul 06 12:11:27 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:28 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f" returned: 0 in 0.980s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3255de4-3ba2-4f3e-905d-181c161ef6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe04089-ec7a-4523-bb7f-fcb5dc72f59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:28 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Volume volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f (5271496a-dbf3-49c7-b4a7-29a1cadef14f): created successfully Jul 06 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe04089-ec7a-4523-bb7f-fcb5dc72f59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Flow 'volume_create_manager' (2f042762-a09b-4661-b885-e1d3d31699f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c138953c-1a44-4abc-b833-32f982362863 tempest-ServersNegativeTestJSON-1921850969 None] Created volume successfully. Jul 06 12:11:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Acquiring lock "cinder-5271496a-dbf3-49c7-b4a7-29a1cadef14f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Lock "cinder-5271496a-dbf3-49c7-b4a7-29a1cadef14f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Acquiring lock "cinder-quobyte-5271496a-dbf3-49c7-b4a7-29a1cadef14f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Lock "cinder-quobyte-5271496a-dbf3-49c7-b4a7-29a1cadef14f" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f3600a-0a1e-4c06-9e4b-7eee988cda56]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:31 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f Jul 06 12:11:31 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:32 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f" returned: 0 in 1.455s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:32 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f Jul 06 12:11:32 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:32 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:11:32 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:34 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.236s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 8 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:11:34 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5271496a-dbf3-49c7-b4a7-29a1cadef14f" returned: 0 in 1.417s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Lock "cinder-quobyte-5271496a-dbf3-49c7-b4a7-29a1cadef14f" released by "delete_volume" :: held 2.939s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Created reservations ['7a5053f8-3fd9-45e9-b00e-212a01ab6ecb', '68260360-0eed-469f-a143-b7defc2bbd95', 'ae145bee-3457-4027-a45a-d43c28ecdcd6', '97e1fb7e-44af-4723-a015-b5508be94bee'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:34 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:11:34 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Acquiring lock "cinder-c8a68a6a-7fa8-4ecf-b172-053068759b44-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Lock "cinder-c8a68a6a-7fa8-4ecf-b172-053068759b44-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Acquiring lock "cinder-quobyte-c8a68a6a-7fa8-4ecf-b172-053068759b44" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Lock "cinder-quobyte-c8a68a6a-7fa8-4ecf-b172-053068759b44" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a38d5a2-f6f5-49f5-a5d9-2f9cffd0695b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:35 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44 Jul 06 12:11:35 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:35 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.889s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:35 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Deleted volume successfully. Jul 06 12:11:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ed12ed42-243a-459d-92c1-5c255c9d54fa tempest-ServersNegativeTestJSON-1921850969 None] Lock "cinder-5271496a-dbf3-49c7-b4a7-29a1cadef14f-delete_volume" released by "delete_volume" :: held 4.149s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:36 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44" returned: 0 in 1.381s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:36 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44 Jul 06 12:11:36 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Flow 'volume_create_manager' (a2dd363c-7256-4d96-82fd-7e86141638bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b462b44d-0218-45d3-a8c6-4ac80d69e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b462b44d-0218-45d3-a8c6-4ac80d69e844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-776808125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e2d01d-5ae9-4853-b360-630f6d8a2ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15729e170de4001bf9d09754b24eb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:37Z,use_quota=True,user_id='25c9732fc4a34643993248d7214b2e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b966ddfc-0161-44c9-97ec-a6e71346ed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b966ddfc-0161-44c9-97ec-a6e71346ed72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f981a6d-9bde-4d60-8a64-3bd8d6ae558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f981a6d-9bde-4d60-8a64-3bd8d6ae558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e2d01d-5ae9-4853-b360-630f6d8a2ce5', 'volume_name': 'volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f228f07f-f8ee-4920-ad48-a98d26249456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f228f07f-f8ee-4920-ad48-a98d26249456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4874ae4-0eb6-4ff9-a36d-3103153dc945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:36 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Volume 91e2d01d-5ae9-4853-b360-630f6d8a2ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5', 'volume_size': 1} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-776808125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e2d01d-5ae9-4853-b360-630f6d8a2ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15729e170de4001bf9d09754b24eb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:37Z,use_quota=True,user_id='25c9732fc4a34643993248d7214b2e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Creating volume 91e2d01d-5ae9-4853-b360-630f6d8a2ce5 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:36 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:11:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:36 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5 1073741824 Jul 06 12:11:36 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:37 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c8a68a6a-7fa8-4ecf-b172-053068759b44" returned: 0 in 1.125s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Lock "cinder-quobyte-c8a68a6a-7fa8-4ecf-b172-053068759b44" released by "delete_volume" :: held 2.608s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:37 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Created reservations ['f9ecc97f-cdda-4fd8-88a3-25162277491b', '78c69864-0fb1-4a99-b510-9dfa678eaca0', '8c2a97e3-9e29-4dc6-91a5-1e7e8006c15c', 'c6182cdb-0303-4df1-a952-68b231532477'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:37 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:11:37 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:38 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5 1073741824" returned: 0 in 1.296s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:38 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5 Jul 06 12:11:38 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:38 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.888s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:38 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Deleted volume successfully. Jul 06 12:11:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-de041f9e-70f2-46df-9c72-b6a1edeec386 tempest-ServersNegativeTestJSON-1921850969 None] Lock "cinder-c8a68a6a-7fa8-4ecf-b172-053068759b44-delete_volume" released by "delete_volume" :: held 3.944s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:39 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5" returned: 0 in 0.932s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.312s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4874ae4-0eb6-4ff9-a36d-3103153dc945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22436b4a-bd12-43d7-9a95-82e6da93690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:39 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Volume volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5 (91e2d01d-5ae9-4853-b360-630f6d8a2ce5): created successfully Jul 06 12:11:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22436b4a-bd12-43d7-9a95-82e6da93690f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Flow 'volume_create_manager' (a2dd363c-7256-4d96-82fd-7e86141638bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9dd822a3-22ce-4c91-a385-a9f4f2010079 tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Created volume successfully. Jul 06 12:11:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Acquiring lock "cinder-28332939-7ec3-4dd1-9708-3a8adfe2f34b-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Lock "cinder-28332939-7ec3-4dd1-9708-3a8adfe2f34b-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Acquiring lock "cinder-quobyte-28332939-7ec3-4dd1-9708-3a8adfe2f34b" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Lock "cinder-quobyte-28332939-7ec3-4dd1-9708-3a8adfe2f34b" acquired by "delete_volume" :: waited 0.039s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c4053b-8447-4f25-81a7-e34aab7c3e3a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:40 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b Jul 06 12:11:40 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Acquiring lock "cinder-91e2d01d-5ae9-4853-b360-630f6d8a2ce5-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Lock "cinder-91e2d01d-5ae9-4853-b360-630f6d8a2ce5-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Acquiring lock "cinder-quobyte-91e2d01d-5ae9-4853-b360-630f6d8a2ce5" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:41 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Lock "cinder-quobyte-91e2d01d-5ae9-4853-b360-630f6d8a2ce5" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b" returned: 0 in 1.260s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[381d09f3-6e0f-4c5a-8ef0-a723346b01ba]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:42 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b Jul 06 12:11:42 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:42 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5 Jul 06 12:11:42 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:42 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-28332939-7ec3-4dd1-9708-3a8adfe2f34b" returned: 0 in 0.832s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Lock "cinder-quobyte-28332939-7ec3-4dd1-9708-3a8adfe2f34b" released by "delete_volume" :: held 2.167s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:42 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Created reservations ['c88ceac7-56f0-4e6b-afdd-2f0c4915e03f', 'e6f6b977-fa37-40e0-9b0e-ffdbe8d9fe6b', 'cc4a2e50-b228-4213-afb0-ddcb82559d17', '5d9883b3-d765-43a7-b19a-5f8844d88270'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:43 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5" returned: 0 in 1.017s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:43 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5 Jul 06 12:11:43 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:43 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:11:43 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:43 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-91e2d01d-5ae9-4853-b360-630f6d8a2ce5" returned: 0 in 0.807s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Lock "cinder-quobyte-91e2d01d-5ae9-4853-b360-630f6d8a2ce5" released by "delete_volume" :: held 1.886s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Created reservations ['118c0e88-3987-4c7b-83eb-268d92bb04fe', '49193978-4f2a-4496-81e7-402096e029cd', '7c6ca90b-61f1-406d-98b2-6afb45f85843', 'a8dc2e32-cc63-4cdf-b060-bee63126b159'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:43 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.829s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:43 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Deleted volume successfully. Jul 06 12:11:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-952e5193-5a43-49cc-9efc-732c02bc3c00 tempest-ServerActionsTestOtherA-1558512385 None] Lock "cinder-28332939-7ec3-4dd1-9708-3a8adfe2f34b-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:44 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:11:44 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Acquiring lock "cinder-67a817c1-976b-484a-8f5e-b912f357b1bb-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Lock "cinder-67a817c1-976b-484a-8f5e-b912f357b1bb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Acquiring lock "cinder-quobyte-67a817c1-976b-484a-8f5e-b912f357b1bb" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:11:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Lock "cinder-quobyte-67a817c1-976b-484a-8f5e-b912f357b1bb" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:11:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6892f9-8b09-4c17-aabe-7b9e36c9d461]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:11:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:45 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb Jul 06 12:11:45 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:45 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.224s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:45 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:45 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Deleted volume successfully. Jul 06 12:11:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd67ce5e-efe0-4748-b0f8-2ba60cdaf3ab tempest-VolumeQuotasNegativeTestJSON-2019350144 None] Lock "cinder-91e2d01d-5ae9-4853-b360-630f6d8a2ce5-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:46 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb" returned: 0 in 1.073s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:46 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb Jul 06 12:11:46 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:47 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-67a817c1-976b-484a-8f5e-b912f357b1bb" returned: 0 in 1.082s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Lock "cinder-quobyte-67a817c1-976b-484a-8f5e-b912f357b1bb" released by "delete_volume" :: held 2.217s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:47 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Created reservations ['8d3b4e0c-c4aa-431e-b4e4-266fd4b861ff', 'e3157d3f-5225-4e06-a505-2825e7f63a3b', 'fb24115b-f239-4d22-85a8-977c0bcafab8', '7e71fb96-f048-4689-8aa6-f1f630cf0fa0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:11:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:47 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:11:47 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:48 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.888s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:48 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:11:48 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Deleted volume successfully. Jul 06 12:11:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0c9e4b46-8a4b-4eec-9576-1de92785e3b5 tempest-TaggedAttachmentsTest-1415168122 None] Lock "cinder-67a817c1-976b-484a-8f5e-b912f357b1bb-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Flow 'volume_create_manager' (a23395c1-1f06-4ae8-9c5e-5c8660f8edec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad36119d-df1f-483b-92a8-5f974bc52763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad36119d-df1f-483b-92a8-5f974bc52763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-60066188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dcc0e1-744c-4533-a550-49e3a4ebe84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441bc1619d6641ac982d1e1d830750d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:57Z,use_quota=True,user_id='cbd7bc139c364e69b5de8f2ed09dff2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99584d1-c97e-467b-b3bb-3aef7d066dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99584d1-c97e-467b-b3bb-3aef7d066dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c832fbd4-24ec-42cb-8e04-c91fdf577cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c832fbd4-24ec-42cb-8e04-c91fdf577cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49dcc0e1-744c-4533-a550-49e3a4ebe84c', 'volume_name': 'volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef03195-a6e5-4d1c-949f-8d1196fb73b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef03195-a6e5-4d1c-949f-8d1196fb73b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0599ee-8e8e-4280-91fa-2de54ba67a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Volume 49dcc0e1-744c-4533-a550-49e3a4ebe84c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c', 'volume_size': 1} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-60066188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dcc0e1-744c-4533-a550-49e3a4ebe84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441bc1619d6641ac982d1e1d830750d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:11:57Z,use_quota=True,user_id='cbd7bc139c364e69b5de8f2ed09dff2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Creating volume 49dcc0e1-744c-4533-a550-49e3a4ebe84c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:11:57 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:11:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:57 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c 1073741824 Jul 06 12:11:57 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:58 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c 1073741824" returned: 0 in 1.088s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:11:58 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c Jul 06 12:11:58 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:11:59 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Jul 06 12:11:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c" returned: 0 in 1.070s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:11:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:11:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.224s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:11:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0599ee-8e8e-4280-91fa-2de54ba67a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b3096b-e0fd-48d0-8429-b1ff7512b06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:11:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Volume volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c (49dcc0e1-744c-4533-a550-49e3a4ebe84c): created successfully Jul 06 12:11:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b3096b-e0fd-48d0-8429-b1ff7512b06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:11:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Flow 'volume_create_manager' (a23395c1-1f06-4ae8-9c5e-5c8660f8edec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:11:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-585c4b73-04ee-4020-8887-db02891120cb req-7010cd88-f17c-4c54-a609-29e909104e7b tempest-VolumesSnapshotsTestJSON-501332784 None] Created volume successfully. Jul 06 12:12:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] Creating offline snapshot 2f4359b4-011b-4a2c-9c02-21affb6be97b of volume 49dcc0e1-744c-4533-a550-49e3a4ebe84c {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:12:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cc8f61-874f-4cc8-9ad5-8070802a4d97]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:01 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c Jul 06 12:12:01 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:02 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c" returned: 0 in 1.397s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:02 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b 1G Jul 06 12:12:02 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:03 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b 1G" returned: 0 in 1.248s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:03 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b Jul 06 12:12:03 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:04 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b" returned: 0 in 0.937s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:04 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b is being set with open permissions: ugo+rw Jul 06 12:12:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:04 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b Jul 06 12:12:04 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:05 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b" returned: 0 in 0.878s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:05 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.info Jul 06 12:12:05 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Flow 'volume_create_manager' (da76a9bb-e7a4-4e36-acfb-de7631d015c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b934e472-7b0f-45d7-b607-164a3f36babb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b934e472-7b0f-45d7-b607-164a3f36babb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1319723992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff41766-0aee-4b62-bca8-251f8f0978e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca9d2c07bd4d539e941264cd8343ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:07Z,use_quota=True,user_id='3185af24adfd46be946535140972701c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ee6da15-c115-436e-8160-8fe86f37f75c),volume_type_id=5ee6da15-c115-436e-8160-8fe86f37f75c)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:06 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7794bff-1ef4-4536-8adb-506d292ce744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7794bff-1ef4-4536-8adb-506d292ce744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7373c553-8602-4361-9c20-e9790e7ce2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7373c553-8602-4361-9c20-e9790e7ce2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff41766-0aee-4b62-bca8-251f8f0978e9', 'volume_name': 'volume-cff41766-0aee-4b62-bca8-251f8f0978e9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c148dcdd-3788-44f9-b813-f6dcaf5fbf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c148dcdd-3788-44f9-b813-f6dcaf5fbf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506282c8-66bb-4355-9d52-f8d62fb75091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Volume cff41766-0aee-4b62-bca8-251f8f0978e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff41766-0aee-4b62-bca8-251f8f0978e9', 'volume_size': 1} Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.info" returned: 0 in 1.147s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:06 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.info is being set with open permissions: ugo+rw Jul 06 12:12:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:06 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.info Jul 06 12:12:06 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:07 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.info" returned: 0 in 0.860s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.626s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1319723992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff41766-0aee-4b62-bca8-251f8f0978e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dca9d2c07bd4d539e941264cd8343ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:07Z,use_quota=True,user_id='3185af24adfd46be946535140972701c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ee6da15-c115-436e-8160-8fe86f37f75c),volume_type_id=5ee6da15-c115-436e-8160-8fe86f37f75c)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Creating volume cff41766-0aee-4b62-bca8-251f8f0978e9 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:12:07 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=68,cinder:UPDATE=79,cinder:INSERT=21,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:12:07 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9 1073741824 Jul 06 12:12:07 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:07 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=52,cinder:UPDATE=77,cinder:DELETE=8,cinder:INSERT=14 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:12:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-364894fe-7bbd-48ac-a75c-9ba2872c7c5f req-46163d0f-89df-4b59-9355-e671bb5e553d tempest-VolumesSnapshotsTestJSON-501332784 None] Create snapshot completed successfully Jul 06 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Acquiring lock "cinder-2f4359b4-011b-4a2c-9c02-21affb6be97b-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "cinder-2f4359b4-011b-4a2c-9c02-21affb6be97b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Acquiring lock "cinder-quobyte-49dcc0e1-744c-4533-a550-49e3a4ebe84c" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "cinder-quobyte-49dcc0e1-744c-4533-a550-49e3a4ebe84c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Acquiring lock "cinder-quobyte-2f4359b4-011b-4a2c-9c02-21affb6be97b" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "cinder-quobyte-2f4359b4-011b-4a2c-9c02-21affb6be97b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Deleting offline snapshot 2f4359b4-011b-4a2c-9c02-21affb6be97b of volume 49dcc0e1-744c-4533-a550-49e3a4ebe84c {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:12:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] snapshot_file for this snap is: volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:12:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86a3560-12d7-475e-81a5-dc0129711395]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:08 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b Jul 06 12:12:08 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:09 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9 1073741824" returned: 0 in 1.488s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:09 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9 Jul 06 12:12:09 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:09 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b" returned: 0 in 1.055s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7f561f-eeab-49fe-ba63-21d5558d364f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:09 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c Jul 06 12:12:09 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:10 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9" returned: 0 in 0.995s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] <== create_volume: return (2564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:12:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.569s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506282c8-66bb-4355-9d52-f8d62fb75091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff41766-0aee-4b62-bca8-251f8f0978e9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda8f658-a580-486a-8aca-0d5a05a432ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:10 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Volume volume-cff41766-0aee-4b62-bca8-251f8f0978e9 (cff41766-0aee-4b62-bca8-251f8f0978e9): created successfully Jul 06 12:12:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda8f658-a580-486a-8aca-0d5a05a432ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Flow 'volume_create_manager' (da76a9bb-e7a4-4e36-acfb-de7631d015c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-732d2463-7ca9-469d-b327-0384c647fd71 tempest-VolumeTypesAccessTest-1425305737 None] Created volume successfully. Jul 06 12:12:10 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c" returned: 0 in 1.056s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:10 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b Jul 06 12:12:10 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Acquiring lock "cinder-cff41766-0aee-4b62-bca8-251f8f0978e9-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Lock "cinder-cff41766-0aee-4b62-bca8-251f8f0978e9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Acquiring lock "cinder-quobyte-cff41766-0aee-4b62-bca8-251f8f0978e9" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Lock "cinder-quobyte-cff41766-0aee-4b62-bca8-251f8f0978e9" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:11 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44d90ab-d753-4c97-93c0-b47f621e1379]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:11 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9 Jul 06 12:12:11 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:12 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b" returned: 0 in 1.405s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:12 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b Jul 06 12:12:12 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:12 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9" returned: 0 in 1.308s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:12 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9 Jul 06 12:12:12 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:13 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c.2f4359b4-011b-4a2c-9c02-21affb6be97b" returned: 0 in 1.117s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "cinder-quobyte-2f4359b4-011b-4a2c-9c02-21affb6be97b" released by "_delete_snapshot" :: held 4.874s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "cinder-quobyte-49dcc0e1-744c-4533-a550-49e3a4ebe84c" released by "delete_snapshot" :: held 4.915s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:13 devstack cinder-volume[86561]: WARNING cinder.quota [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG cinder.quota [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Created reservations ['0fd7311e-8425-4c31-916b-484aa39b2218', 'db2cec20-eef7-47c8-bf9d-06f37c740b64', '43b3133c-5c36-4999-913b-3aceff0b17b8', 'cf93ee47-4b7b-41e7-a910-124b52b2c560'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:13 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cff41766-0aee-4b62-bca8-251f8f0978e9" returned: 0 in 1.019s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Lock "cinder-quobyte-cff41766-0aee-4b62-bca8-251f8f0978e9" released by "delete_volume" :: held 2.391s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:13 devstack cinder-volume[86561]: WARNING cinder.quota [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2014395051 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2014395051, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:12:13 devstack cinder-volume[86561]: WARNING cinder.quota [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2014395051 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2014395051, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:12:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Delete snapshot completed successfully. Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-45574b5b-4b4d-4809-bf0d-50c91dd1808d req-e6a05b69-aefa-46dd-b329-939b47d72bf4 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "cinder-2f4359b4-011b-4a2c-9c02-21affb6be97b-delete_snapshot" released by "delete_snapshot" :: held 5.212s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Created reservations ['683727f7-00c7-4b41-bf4f-fc57f3000973', '27970c6a-d2a2-4e42-aff9-abd1dee4d8b0', '17a9699e-00e5-4c01-9b2e-2868bafe54fb', '1486d21a-b25e-4b19-a54d-956e9f530f9a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:13 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:12:13 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Acquiring lock "cinder-49dcc0e1-744c-4533-a550-49e3a4ebe84c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "cinder-49dcc0e1-744c-4533-a550-49e3a4ebe84c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Acquiring lock "cinder-quobyte-49dcc0e1-744c-4533-a550-49e3a4ebe84c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "cinder-quobyte-49dcc0e1-744c-4533-a550-49e3a4ebe84c" acquired by "delete_volume" :: waited 0.039s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:14 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d81399-4e03-4cea-aa67-81235eb22afc]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:14 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c Jul 06 12:12:14 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:14 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.108s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:14 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Deleted volume successfully. Jul 06 12:12:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d80c7847-9fe7-47e3-acd2-9056bd691332 tempest-VolumeTypesAccessTest-1425305737 None] Lock "cinder-cff41766-0aee-4b62-bca8-251f8f0978e9-delete_volume" released by "delete_volume" :: held 3.841s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:15 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c" returned: 0 in 1.468s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:15 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c Jul 06 12:12:15 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:16 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-49dcc0e1-744c-4533-a550-49e3a4ebe84c" returned: 0 in 1.044s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "cinder-quobyte-49dcc0e1-744c-4533-a550-49e3a4ebe84c" released by "delete_volume" :: held 2.613s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:17 devstack cinder-volume[86561]: DEBUG cinder.quota [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Created reservations ['817ac471-faf2-4fa9-a1c5-59bcec7cc2d0', '01258cb1-119d-4ab6-9cb5-ac03f3296d2e', '63e452d2-658c-4223-b183-5344260e2015', '356a959f-08c5-4160-a14c-29a6524e8bba'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:12:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:17 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:12:17 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:18 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.020s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:18 devstack cinder-volume[86561]: DEBUG cinder.manager [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Deleted volume successfully. Jul 06 12:12:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-fe620351-dde0-456d-b8fd-ce741a6b372e req-ee4b28f5-8a12-4bc5-a476-f148f2aa3580 tempest-VolumesSnapshotsTestJSON-501332784 None] Lock "cinder-49dcc0e1-744c-4533-a550-49e3a4ebe84c-delete_volume" released by "delete_volume" :: held 4.005s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:12:27 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:DELETE=1,cinder:SELECT=20,cinder:INSERT=8,cinder:UPDATE=26 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:12:28 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:12:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:12:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:32 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:12:32 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:33 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.782s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:12:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:12:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 8 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:12:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:12:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ab1994ff-ccac-4ade-8b97-d64af117c61d tempest-GroupSnapshotsV319Test-350109814 None] Group tempest-GroupSnapshotsV319Test-Group-115639808: creating Jul 06 12:12:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ab1994ff-ccac-4ade-8b97-d64af117c61d tempest-GroupSnapshotsV319Test-350109814 None] Group tempest-GroupSnapshotsV319Test-Group-115639808: created successfully Jul 06 12:12:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ab1994ff-ccac-4ade-8b97-d64af117c61d tempest-GroupSnapshotsV319Test-350109814 None] Create group completed successfully. Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Flow 'volume_create_manager' (7ce22dcc-ff5b-4808-9325-5af2f8a80566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f02f5f-87e9-445d-9def-b3bec501e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f02f5f-87e9-445d-9def-b3bec501e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-861378733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa4e44a7-bffb-4d17-8855-2db580ca375d,host='devstack@QuobyteHD#QuobyteHD',id=fb8afdf0-28eb-4999-9d01-ef5689ca7028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f194ea3b88a4e83a21204b3744eba0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:37Z,use_quota=True,user_id='5f1098d2fd4543d9b7079baceef79792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b3e23d2-78cf-4587-a9c3-7448f59960c0),volume_type_id=3b3e23d2-78cf-4587-a9c3-7448f59960c0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1f5768-54c7-417d-a244-5c7b6b530671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1f5768-54c7-417d-a244-5c7b6b530671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dda13f6-da61-476e-87ec-d2077b907fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dda13f6-da61-476e-87ec-d2077b907fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb8afdf0-28eb-4999-9d01-ef5689ca7028', 'volume_name': 'volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d07e28-b66f-4967-bbad-99db8d400cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d07e28-b66f-4967-bbad-99db8d400cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f1e8f5-b029-48d8-a3d3-2f6767bdd02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:37 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Volume fb8afdf0-28eb-4999-9d01-ef5689ca7028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028', 'volume_size': 1} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aa4e44a7-bffb-4d17-8855-2db580ca375d,created_at=2026-07-06T10:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-861378733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa4e44a7-bffb-4d17-8855-2db580ca375d,host='devstack@QuobyteHD#QuobyteHD',id=fb8afdf0-28eb-4999-9d01-ef5689ca7028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f194ea3b88a4e83a21204b3744eba0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:37Z,use_quota=True,user_id='5f1098d2fd4543d9b7079baceef79792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b3e23d2-78cf-4587-a9c3-7448f59960c0),volume_type_id=3b3e23d2-78cf-4587-a9c3-7448f59960c0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Creating volume fb8afdf0-28eb-4999-9d01-ef5689ca7028 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:12:37 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:12:37 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 1073741824 Jul 06 12:12:37 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Flow 'volume_create_manager' (ce10f0a9-9b4c-4a80-bee0-b1db008f0f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38951f6-21c2-48ae-9722-e794509e355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38951f6-21c2-48ae-9722-e794509e355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2028107054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ab2e67-7bdf-474a-997f-8c3f64ae45a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da83dbcdbc1f44e69f77102fa4e2e7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:37Z,use_quota=True,user_id='d807bf489bcc4031919c1847e4e70ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5152fd17-a032-45a2-ab44-88c09d226210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5152fd17-a032-45a2-ab44-88c09d226210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6005b4d0-4c70-4c24-b82d-edae2ba93ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6005b4d0-4c70-4c24-b82d-edae2ba93ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ab2e67-7bdf-474a-997f-8c3f64ae45a5', 'volume_name': 'volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847f170e-ef92-4004-b968-1d4cc91a3548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847f170e-ef92-4004-b968-1d4cc91a3548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ae3f92-864b-4d77-9005-53d2bba8a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:37 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Volume 78ab2e67-7bdf-474a-997f-8c3f64ae45a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5', 'volume_size': 1} Jul 06 12:12:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:38 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 1073741824" returned: 0 in 1.423s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:39 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 Jul 06 12:12:39 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:40 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028" returned: 0 in 1.047s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] <== create_volume: return (2536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.540s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.376s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2028107054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ab2e67-7bdf-474a-997f-8c3f64ae45a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da83dbcdbc1f44e69f77102fa4e2e7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:12:37Z,use_quota=True,user_id='d807bf489bcc4031919c1847e4e70ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Creating volume 78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:12:40 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:40 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 1073741824 Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f1e8f5-b029-48d8-a3d3-2f6767bdd02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:40 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3293ee45-7bbc-4c08-aba5-c27a6fd32b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:40 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Volume volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 (fb8afdf0-28eb-4999-9d01-ef5689ca7028): created successfully Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3293ee45-7bbc-4c08-aba5-c27a6fd32b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Flow 'volume_create_manager' (7ce22dcc-ff5b-4808-9325-5af2f8a80566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:40 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e4ca5c25-16b6-41ef-a7c0-8d7b9519a43b tempest-GroupSnapshotsV319Test-350109814 None] Created volume successfully. Jul 06 12:12:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] GroupSnapshot 0f2b6d94-75b2-459b-a59c-77b99c0b4726: creating. Jul 06 12:12:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] Group snapshot 0f2b6d94-75b2-459b-a59c-77b99c0b4726: creating. {{(pid=86561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:12:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:41 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 1073741824" returned: 0 in 1.725s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:41 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 Jul 06 12:12:41 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:43 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" returned: 0 in 1.288s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] <== create_volume: return (3080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:12:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.085s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.436s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ae3f92-864b-4d77-9005-53d2bba8a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb631d1-4362-4752-a258-c54f8df5d06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:12:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] Creating offline snapshot c6e3830f-b261-4c06-ba57-46916a208e52 of volume fb8afdf0-28eb-4999-9d01-ef5689ca7028 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:12:43 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Volume volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 (78ab2e67-7bdf-474a-997f-8c3f64ae45a5): created successfully Jul 06 12:12:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb631d1-4362-4752-a258-c54f8df5d06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:12:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Flow 'volume_create_manager' (ce10f0a9-9b4c-4a80-bee0-b1db008f0f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:12:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b41b187-d9a4-4836-a27a-56dc623c9555]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a50a59dd-1eb2-4885-bd65-2f5bd3b00edf tempest-VolumesDeleteCascade-1367877999 None] Created volume successfully. Jul 06 12:12:43 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 Jul 06 12:12:43 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:12:44 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028" returned: 0 in 1.586s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:44 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 1G Jul 06 12:12:44 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:46 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 1G" returned: 0 in 1.144s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:46 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 Jul 06 12:12:46 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:47 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52" returned: 0 in 1.060s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:47 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:12:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:47 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 Jul 06 12:12:47 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:48 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52" returned: 0 in 1.275s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:48 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.info Jul 06 12:12:48 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:49 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.info" returned: 0 in 0.888s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:49 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:12:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:49 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.info Jul 06 12:12:49 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:51 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.info" returned: 0 in 1.754s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.966s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:12:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.674s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:12:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] Creating offline snapshot 6a4cd497-566a-4fca-b52a-e91153ab5d29 of volume 78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:12:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cbeb84-0fc3-44a1-8c13-cee2087ee855]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-334d56b6-6133-45f1-bd1a-056fc2c6f5ed tempest-GroupSnapshotsV319Test-350109814 None] group_snapshot 0f2b6d94-75b2-459b-a59c-77b99c0b4726: created successfully Jul 06 12:12:51 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 Jul 06 12:12:51 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:53 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" returned: 0 in 2.165s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] group_snapshot 0f2b6d94-75b2-459b-a59c-77b99c0b4726: deleting Jul 06 12:12:53 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 1G Jul 06 12:12:53 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] group_snapshot 0f2b6d94-75b2-459b-a59c-77b99c0b4726: deleting {{(pid=86561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:12:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Acquiring lock "cinder-quobyte-fb8afdf0-28eb-4999-9d01-ef5689ca7028" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Lock "cinder-quobyte-fb8afdf0-28eb-4999-9d01-ef5689ca7028" acquired by "delete_snapshot" :: waited 0.075s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Acquiring lock "cinder-quobyte-c6e3830f-b261-4c06-ba57-46916a208e52" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:12:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Lock "cinder-quobyte-c6e3830f-b261-4c06-ba57-46916a208e52" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:12:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Deleting offline snapshot c6e3830f-b261-4c06-ba57-46916a208e52 of volume fb8afdf0-28eb-4999-9d01-ef5689ca7028 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:12:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] snapshot_file for this snap is: volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:12:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb633301-916f-47b8-97fc-c6c2412bc2e1]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:54 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 Jul 06 12:12:54 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:56 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 1G" returned: 0 in 2.605s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:56 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 Jul 06 12:12:56 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:56 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52" returned: 0 in 2.476s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:12:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5ee859-be38-4ec3-a120-0c0558b17243]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:12:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:57 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 Jul 06 12:12:57 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:58 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29" returned: 0 in 2.080s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:58 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 is being set with open permissions: ugo+rw Jul 06 12:12:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:58 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 Jul 06 12:12:58 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:58 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028" returned: 0 in 2.120s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:12:59 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 Jul 06 12:12:59 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:12:59 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Jul 06 12:12:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29" returned: 0 in 1.614s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:12:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:00 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.info Jul 06 12:13:00 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:01 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52" returned: 0 in 2.075s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:01 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52 Jul 06 12:13:01 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:01 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.info" returned: 0 in 1.762s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:01 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.info is being set with open permissions: ugo+rw Jul 06 12:13:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:01 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.info Jul 06 12:13:01 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:03 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028.c6e3830f-b261-4c06-ba57-46916a208e52" returned: 0 in 2.252s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Lock "cinder-quobyte-c6e3830f-b261-4c06-ba57-46916a208e52" released by "_delete_snapshot" :: held 9.224s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Lock "cinder-quobyte-fb8afdf0-28eb-4999-9d01-ef5689ca7028" released by "delete_snapshot" :: held 9.308s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:03 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.info" returned: 0 in 1.633s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 12.256s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-09905d21-f71c-426b-b91d-375f1b8ecb17 tempest-VolumesDeleteCascade-1367877999 None] Create snapshot completed successfully Jul 06 12:13:03 devstack cinder-volume[86561]: WARNING cinder.quota [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1662678460 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1662678460, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:13:03 devstack cinder-volume[86561]: WARNING cinder.quota [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1662678460 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1662678460, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:13:03 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] Created reservations ['7ddf2d37-032b-41e0-972a-0b58241cca27', '7bb20a64-4286-4206-948e-bc170aa0c19c', '59820d75-f67b-4462-96f3-82c5a26a7f5d', 'ee4abd4f-2503-40e2-be1d-527d10c5b82a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1cdfe70b-06f5-4742-93b7-bdf36026bd79 tempest-GroupSnapshotsV319Test-350109814 None] group_snapshot 0f2b6d94-75b2-459b-a59c-77b99c0b4726: deleted successfully Jul 06 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] Creating offline snapshot d2a83aa0-e78e-47eb-a0ea-999d544148bc of volume 78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:13:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48868ff-80bf-46b3-9b18-5f11c40d3503]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Acquiring lock "cinder-quobyte-fb8afdf0-28eb-4999-9d01-ef5689ca7028" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Lock "cinder-quobyte-fb8afdf0-28eb-4999-9d01-ef5689ca7028" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:04 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 Jul 06 12:13:04 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a246090-cea7-43d3-8f36-0372bf939851]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:05 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 Jul 06 12:13:05 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:06 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29" returned: 0 in 1.470s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:06 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc 1G Jul 06 12:13:06 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:06 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028" returned: 0 in 1.310s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:06 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028 Jul 06 12:13:06 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:07 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb8afdf0-28eb-4999-9d01-ef5689ca7028" returned: 0 in 1.196s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Lock "cinder-quobyte-fb8afdf0-28eb-4999-9d01-ef5689ca7028" released by "delete_volume" :: held 2.633s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Created reservations ['192327a0-41c3-4209-9291-b5dba0aa29bf'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:07 devstack cinder-volume[86561]: WARNING cinder.quota [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1662678460 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1662678460, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Created reservations ['d8541da9-a10a-40de-9cb2-5c4cbcc8dc99', '3757a176-2940-4050-9ce1-bc8a1ab13d5f', 'aa2e5f25-2c7a-481b-acfa-21ecc536ef55', '5e2c0438-85b5-43a2-8fc2-2df0587538bb'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:08 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:13:08 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:08 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc 1G" returned: 0 in 2.032s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:08 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc Jul 06 12:13:08 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Flow 'volume_create_manager' (9431ad65-e469-472a-970f-8cb9080be037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e6ddf2-1c05-4086-a597-aa730265c529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e6ddf2-1c05-4086-a597-aa730265c529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-617585321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee49a5c-dba2-4852-b237-803f19bd20f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='516dcc01a5c1435586bc00c8542a5abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:09Z,use_quota=True,user_id='7ae3488c23c94e7aaa8b85bfafee7bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d957e3-0074-4927-82b6-bcbcb01bba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d957e3-0074-4927-82b6-bcbcb01bba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e120fc6b-c854-46be-a210-f50a8e16c38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e120fc6b-c854-46be-a210-f50a8e16c38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee49a5c-dba2-4852-b237-803f19bd20f2', 'volume_name': 'volume-5ee49a5c-dba2-4852-b237-803f19bd20f2', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c91b7a-f78d-413f-b578-8c8e95c9c044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c91b7a-f78d-413f-b578-8c8e95c9c044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f881f3-c180-4b07-98ea-f9934b295094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Volume 5ee49a5c-dba2-4852-b237-803f19bd20f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee49a5c-dba2-4852-b237-803f19bd20f2', 'volume_size': 1} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:09 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.356s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0d1e9929-f21b-47f8-b2e0-0d7c8a7fa822 tempest-GroupSnapshotsV319Test-350109814 None] Delete group completed successfully. Jul 06 12:13:09 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc" returned: 0 in 1.610s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:09 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc is being set with open permissions: ugo+rw Jul 06 12:13:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:09 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc Jul 06 12:13:09 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:10 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc" returned: 0 in 1.105s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.375s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-617585321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee49a5c-dba2-4852-b237-803f19bd20f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='516dcc01a5c1435586bc00c8542a5abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:09Z,use_quota=True,user_id='7ae3488c23c94e7aaa8b85bfafee7bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Creating volume 5ee49a5c-dba2-4852-b237-803f19bd20f2 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:10 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:13:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:10 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2 1073741824 Jul 06 12:13:10 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c5827169-8f87-4250-b1d6-18418223ef72 tempest-VolumesDeleteCascade-1367877999 None] Create snapshot completed successfully Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-78ab2e67-7bdf-474a-997f-8c3f64ae45a5-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-78ab2e67-7bdf-474a-997f-8c3f64ae45a5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Performing cascade delete. {{(pid=86561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-6a4cd497-566a-4fca-b52a-e91153ab5d29-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-6a4cd497-566a-4fca-b52a-e91153ab5d29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-quobyte-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-quobyte-6a4cd497-566a-4fca-b52a-e91153ab5d29" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-6a4cd497-566a-4fca-b52a-e91153ab5d29" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Deleting offline snapshot 6a4cd497-566a-4fca-b52a-e91153ab5d29 of volume 78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] snapshot_file for this snap is: volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d28628-bffe-497f-9d26-b886db146ed8]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:12 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2 1073741824" returned: 0 in 1.812s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:12 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2 Jul 06 12:13:12 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:12 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 Jul 06 12:13:12 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:13 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2" returned: 0 in 1.064s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] <== create_volume: return (2996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.999s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f881f3-c180-4b07-98ea-f9934b295094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee49a5c-dba2-4852-b237-803f19bd20f2', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e999e2ac-363b-433a-b5cd-135d8d11931e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:13 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Volume volume-5ee49a5c-dba2-4852-b237-803f19bd20f2 (5ee49a5c-dba2-4852-b237-803f19bd20f2): created successfully Jul 06 12:13:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e999e2ac-363b-433a-b5cd-135d8d11931e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Flow 'volume_create_manager' (9431ad65-e469-472a-970f-8cb9080be037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8eadf7ab-90d2-4e82-8a9b-7d5a5f7e22c0 tempest-ServerRescueNegativeTestJSON-268176377 None] Created volume successfully. Jul 06 12:13:14 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29" returned: 0 in 1.858s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:14 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb72433-7df0-41a9-86fa-ed06576e99cc]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:14 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 Jul 06 12:13:14 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:15 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" returned: 0 in 1.192s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[600324bd-6e47-4bad-964c-689c422dcac0]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:16 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc Jul 06 12:13:16 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:17 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc" returned: 0 in 1.234s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7085d1-9c19-4cd4-afa9-e383b4980e5d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:17 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 Jul 06 12:13:17 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:18 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29" returned: 0 in 1.193s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bec1641-e686-4fa4-819a-bb92bb03fc76]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:18 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 Jul 06 12:13:18 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-598d9362-e8f2-40bd-9a09-502e80ef5fc6 tempest-GroupsV320Test-1344553228 None] Group tempest-GroupsV320Test-Group-1736897959: creating Jul 06 12:13:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-598d9362-e8f2-40bd-9a09-502e80ef5fc6 tempest-GroupsV320Test-1344553228 None] Group tempest-GroupsV320Test-Group-1736897959: created successfully Jul 06 12:13:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-598d9362-e8f2-40bd-9a09-502e80ef5fc6 tempest-GroupsV320Test-1344553228 None] Create group completed successfully. Jul 06 12:13:19 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" returned: 0 in 1.161s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:19 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 Jul 06 12:13:19 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:20 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29" returned: 0 in 1.048s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:20 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29 Jul 06 12:13:20 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a60935a8-2b24-4f6d-abc8-a80f77f0ab34 tempest-GroupsV320Test-1344553228 None] Created reservations ['f447756b-9d5a-418c-ba10-9914d2254715'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a60935a8-2b24-4f6d-abc8-a80f77f0ab34 tempest-GroupsV320Test-1344553228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a60935a8-2b24-4f6d-abc8-a80f77f0ab34 tempest-GroupsV320Test-1344553228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a60935a8-2b24-4f6d-abc8-a80f77f0ab34 tempest-GroupsV320Test-1344553228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a60935a8-2b24-4f6d-abc8-a80f77f0ab34 tempest-GroupsV320Test-1344553228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a60935a8-2b24-4f6d-abc8-a80f77f0ab34 tempest-GroupsV320Test-1344553228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a60935a8-2b24-4f6d-abc8-a80f77f0ab34 tempest-GroupsV320Test-1344553228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:20 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:13:20 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:21 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.6a4cd497-566a-4fca-b52a-e91153ab5d29" returned: 0 in 0.890s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc -F qcow2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:21 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc -F qcow2 Jul 06 12:13:21 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:21 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a60935a8-2b24-4f6d-abc8-a80f77f0ab34 tempest-GroupsV320Test-1344553228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.921s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:21 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a60935a8-2b24-4f6d-abc8-a80f77f0ab34 tempest-GroupsV320Test-1344553228 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a60935a8-2b24-4f6d-abc8-a80f77f0ab34 tempest-GroupsV320Test-1344553228 None] Delete group completed successfully. Jul 06 12:13:22 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc -F qcow2" returned: 0 in 0.950s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-6a4cd497-566a-4fca-b52a-e91153ab5d29" released by "_delete_snapshot" :: held 9.886s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" released by "delete_snapshot" :: held 9.955s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Created reservations ['e707562b-d199-4689-b7e7-b1b5ab5e73ef', 'a6f631ac-f47b-49c6-a759-f8bc4d6eadfd', '7ed57db3-7c80-4d26-b8e3-431916306913', 'a41db79c-abba-40a3-bed8-406ce5c676ed'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Delete snapshot completed successfully. Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-6a4cd497-566a-4fca-b52a-e91153ab5d29-delete_snapshot" released by "delete_snapshot" :: held 10.282s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-d2a83aa0-e78e-47eb-a0ea-999d544148bc-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-d2a83aa0-e78e-47eb-a0ea-999d544148bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-quobyte-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-quobyte-d2a83aa0-e78e-47eb-a0ea-999d544148bc" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-d2a83aa0-e78e-47eb-a0ea-999d544148bc" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Deleting offline snapshot d2a83aa0-e78e-47eb-a0ea-999d544148bc of volume 78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] snapshot_file for this snap is: volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[812a650d-258e-4044-9e5e-24293f1328e1]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:22 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc Jul 06 12:13:22 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Flow 'volume_create_manager' (8317a37c-95dc-40e3-a13e-acd6489d8ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7947eb23-d6a7-4620-ae7b-ebc41cd5b1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7947eb23-d6a7-4620-ae7b-ebc41cd5b1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1087466469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ffc89a-181d-47b1-8193-58b64cce1ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3927b5d8664c48a27eaa8c91c2dcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:23Z,use_quota=True,user_id='2c307aca0123418aabe8c8d460eec3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95d8d5f-1540-42c0-9e95-0c5e238d1a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95d8d5f-1540-42c0-9e95-0c5e238d1a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e700bd7f-e2d3-4f24-89ac-159c1a37ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e700bd7f-e2d3-4f24-89ac-159c1a37ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ffc89a-181d-47b1-8193-58b64cce1ae5', 'volume_name': 'volume-03ffc89a-181d-47b1-8193-58b64cce1ae5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29aed7ba-0ef9-4215-9f8f-3fc8375accef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29aed7ba-0ef9-4215-9f8f-3fc8375accef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58616ac7-d40d-450b-953b-7b1dc700739c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Volume 03ffc89a-181d-47b1-8193-58b64cce1ae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ffc89a-181d-47b1-8193-58b64cce1ae5', 'volume_size': 1} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1087466469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ffc89a-181d-47b1-8193-58b64cce1ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3927b5d8664c48a27eaa8c91c2dcd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:23Z,use_quota=True,user_id='2c307aca0123418aabe8c8d460eec3f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Creating volume 03ffc89a-181d-47b1-8193-58b64cce1ae5 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:23 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:23 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5 1073741824 Jul 06 12:13:23 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:23 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc" returned: 0 in 1.139s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad2e57d-412b-4343-8832-d993ba7a8cbe]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:24 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 Jul 06 12:13:24 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:24 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5 1073741824" returned: 0 in 1.280s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:24 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5 Jul 06 12:13:24 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:25 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" returned: 0 in 1.330s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:25 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc Jul 06 12:13:25 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:25 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5" returned: 0 in 1.189s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] <== create_volume: return (2528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.543s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58616ac7-d40d-450b-953b-7b1dc700739c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ffc89a-181d-47b1-8193-58b64cce1ae5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c1fc37-6344-4000-8d20-8d4903e0b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Volume volume-03ffc89a-181d-47b1-8193-58b64cce1ae5 (03ffc89a-181d-47b1-8193-58b64cce1ae5): created successfully Jul 06 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c1fc37-6344-4000-8d20-8d4903e0b06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Flow 'volume_create_manager' (8317a37c-95dc-40e3-a13e-acd6489d8ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5821877f-1915-4d2b-bd37-181e954fe674 tempest-AttachVolumeShelveTestJSON-1458163877 None] Created volume successfully. Jul 06 12:13:26 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc" returned: 0 in 1.233s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:26 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc Jul 06 12:13:26 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:28 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5.d2a83aa0-e78e-47eb-a0ea-999d544148bc" returned: 0 in 1.706s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-d2a83aa0-e78e-47eb-a0ea-999d544148bc" released by "_delete_snapshot" :: held 5.579s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" released by "delete_snapshot" :: held 5.628s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=40,cinder:UPDATE=48,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=62,cinder:UPDATE=40,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Created reservations ['4108d36f-5e0d-43bf-84bb-5a9db8409eff', 'a88f2fc2-48f9-4b07-b3a6-fe7622be2338', '737b2b59-bf20-4e77-be7c-871bd81c71c7', '13827f12-7b46-43b6-9eea-87793b8b8920'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Delete snapshot completed successfully. Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-d2a83aa0-e78e-47eb-a0ea-999d544148bc-delete_snapshot" released by "delete_snapshot" :: held 6.020s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Snapshots deleted, issuing volume delete {{(pid=86561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-quobyte-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" acquired by "delete_volume" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[473b51d3-1607-47bf-a0c7-bbefadcd950d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:29 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 Jul 06 12:13:29 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:30 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" returned: 0 in 2.039s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:30 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5 Jul 06 12:13:30 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:32 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" returned: 0 in 1.137s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-78ab2e67-7bdf-474a-997f-8c3f64ae45a5" released by "delete_volume" :: held 3.369s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Created reservations ['930f8a03-84bb-453f-9467-3f670bba4e5f', '133b02ef-3c55-4aea-a55e-1ccdb34bf97d', '1b4fc4d0-22a2-4dc4-9d3c-79bb17fec6ce', '337df5ef-6f44-4644-96fe-548e8a0229c3'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:32 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:13:32 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 8 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:13:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:13:33 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.940s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Deleted volume successfully. Jul 06 12:13:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-495debfd-f2dd-4ce2-9b95-8560eb01d9f8 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-78ab2e67-7bdf-474a-997f-8c3f64ae45a5-delete_volume" released by "delete_volume" :: held 21.070s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Flow 'volume_create_manager' (fa0b3ebf-7310-43b4-84f3-6958843f29ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b749c299-b33c-4d7f-ac14-ef923b6a19c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b749c299-b33c-4d7f-ac14-ef923b6a19c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1870050386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614018a5-f461-48ef-a279-c1efdd845e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da83dbcdbc1f44e69f77102fa4e2e7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:34Z,use_quota=True,user_id='d807bf489bcc4031919c1847e4e70ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63471617-cd0c-4692-b6b0-a091e9edebac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63471617-cd0c-4692-b6b0-a091e9edebac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68187080-3db6-4472-889a-64d1cd4ec59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68187080-3db6-4472-889a-64d1cd4ec59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '614018a5-f461-48ef-a279-c1efdd845e95', 'volume_name': 'volume-614018a5-f461-48ef-a279-c1efdd845e95', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7311473-7578-4793-809e-0082f369d195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7311473-7578-4793-809e-0082f369d195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3981318b-d58a-47da-afaa-ba5b795e035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Volume 614018a5-f461-48ef-a279-c1efdd845e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-614018a5-f461-48ef-a279-c1efdd845e95', 'volume_size': 1} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1870050386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614018a5-f461-48ef-a279-c1efdd845e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da83dbcdbc1f44e69f77102fa4e2e7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:34Z,use_quota=True,user_id='d807bf489bcc4031919c1847e4e70ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Creating volume 614018a5-f461-48ef-a279-c1efdd845e95 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:34 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:13:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:34 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 1073741824 Jul 06 12:13:34 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:35 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 1073741824" returned: 0 in 1.482s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:36 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 Jul 06 12:13:36 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Acquiring lock "cinder-5ee49a5c-dba2-4852-b237-803f19bd20f2-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Lock "cinder-5ee49a5c-dba2-4852-b237-803f19bd20f2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Acquiring lock "cinder-quobyte-5ee49a5c-dba2-4852-b237-803f19bd20f2" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Lock "cinder-quobyte-5ee49a5c-dba2-4852-b237-803f19bd20f2" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b57a4f9-7bae-4dea-b041-2ac8a4044635]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:36 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2 Jul 06 12:13:36 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:37 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95" returned: 0 in 1.519s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] <== create_volume: return (3126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:13:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.132s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3981318b-d58a-47da-afaa-ba5b795e035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614018a5-f461-48ef-a279-c1efdd845e95', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77853a11-83b6-466a-bf8d-4e297abe7359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:37 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Volume volume-614018a5-f461-48ef-a279-c1efdd845e95 (614018a5-f461-48ef-a279-c1efdd845e95): created successfully Jul 06 12:13:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77853a11-83b6-466a-bf8d-4e297abe7359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Flow 'volume_create_manager' (fa0b3ebf-7310-43b4-84f3-6958843f29ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0299bbb1-17e9-4b8f-a317-6d7fc0c923e1 tempest-VolumesDeleteCascade-1367877999 None] Created volume successfully. Jul 06 12:13:38 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2" returned: 0 in 1.548s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:38 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2 Jul 06 12:13:38 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] Creating offline snapshot edd18926-d107-4fc9-bf59-feeec58bfbdd of volume 614018a5-f461-48ef-a279-c1efdd845e95 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:13:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88ab19a-61c5-464f-9b85-28e0980bfaa4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:39 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 Jul 06 12:13:39 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:39 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ee49a5c-dba2-4852-b237-803f19bd20f2" returned: 0 in 1.651s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Lock "cinder-quobyte-5ee49a5c-dba2-4852-b237-803f19bd20f2" released by "delete_volume" :: held 3.305s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:40 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Created reservations ['ba66253e-39e5-46c0-a925-21143226e201', 'cd25d737-826e-495e-bc3d-8157f63046ba', 'a0421b96-3f8c-4f17-8f40-c32996b1e028', '0d94b27f-5d41-4d2a-8ba3-85e84034f99e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:13:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:40 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:13:40 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:41 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95" returned: 0 in 1.931s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:41 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd 1G Jul 06 12:13:41 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:42 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.487s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:42 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:13:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Deleted volume successfully. Jul 06 12:13:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-163745e9-6d02-429d-be5c-9deadb5f828d tempest-ServerRescueNegativeTestJSON-268176377 None] Lock "cinder-5ee49a5c-dba2-4852-b237-803f19bd20f2-delete_volume" released by "delete_volume" :: held 5.621s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:13:43 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd 1G" returned: 0 in 2.069s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-614018a5-f461-48ef-a279-c1efdd845e95 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:43 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-614018a5-f461-48ef-a279-c1efdd845e95 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd Jul 06 12:13:43 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:44 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-614018a5-f461-48ef-a279-c1efdd845e95 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd" returned: 0 in 1.413s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:44 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd is being set with open permissions: ugo+rw Jul 06 12:13:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:44 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd Jul 06 12:13:44 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:46 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd" returned: 0 in 1.994s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:46 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.info Jul 06 12:13:46 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:48 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.info" returned: 0 in 1.345s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:48 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.info is being set with open permissions: ugo+rw Jul 06 12:13:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:48 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.info Jul 06 12:13:48 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:49 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.info" returned: 0 in 0.901s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.855s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f32e540e-221c-4349-aadc-65221b87adc3 tempest-VolumesDeleteCascade-1367877999 None] Create snapshot completed successfully Jul 06 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-b827e93a-fb9c-4b7e-b508-0faafb2fe8e4 req-4ff7d553-5bb1-4298-bd81-24b524f38c05 tempest-AttachVolumeShelveTestJSON-1458163877 None] No connector for attachment 7c46f53a-84fb-4e57-8a9e-a8ca6ff712cc; skipping storage backend terminate_connection call. {{(pid=86561) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 06 12:13:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-b827e93a-fb9c-4b7e-b508-0faafb2fe8e4 req-4ff7d553-5bb1-4298-bd81-24b524f38c05 tempest-AttachVolumeShelveTestJSON-1458163877 None] Deleting attachment 7c46f53a-84fb-4e57-8a9e-a8ca6ff712cc. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Flow 'volume_create_manager' (a46d6294-49a3-4993-8d7e-d22b7ee87ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413ad125-d971-43c9-bdde-938fe93b0706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413ad125-d971-43c9-bdde-938fe93b0706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-264406953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e5aadb-82f1-4a80-92b4-255c55503370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da83dbcdbc1f44e69f77102fa4e2e7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=edd18926-d107-4fc9-bf59-feeec58bfbdd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:13:51Z,use_quota=True,user_id='d807bf489bcc4031919c1847e4e70ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b387966-9949-4110-bb7a-dd9a58162924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b387966-9949-4110-bb7a-dd9a58162924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631cb693-802b-4c39-bcb1-785830307f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631cb693-802b-4c39-bcb1-785830307f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e4e5aadb-82f1-4a80-92b4-255c55503370', 'volume_name': 'volume-e4e5aadb-82f1-4a80-92b4-255c55503370', 'volume_size': 1, 'snapshot_id': 'edd18926-d107-4fc9-bf59-feeec58bfbdd'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8778e6d-a960-4e8d-b566-2bc9fa5a8371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8778e6d-a960-4e8d-b566-2bc9fa5a8371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:13:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0928cbcf-5af8-4a7d-b2d8-9efac3e76f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:13:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Volume e4e5aadb-82f1-4a80-92b4-255c55503370: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e4e5aadb-82f1-4a80-92b4-255c55503370', 'volume_size': 1, 'snapshot_id': 'edd18926-d107-4fc9-bf59-feeec58bfbdd'} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-quobyte-edd18926-d107-4fc9-bf59-feeec58bfbdd-e4e5aadb-82f1-4a80-92b4-255c55503370" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-edd18926-d107-4fc9-bf59-feeec58bfbdd-e4e5aadb-82f1-4a80-92b4-255c55503370" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Creating volume e4e5aadb-82f1-4a80-92b4-255c55503370 from snapshot edd18926-d107-4fc9-bf59-feeec58bfbdd {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-quobyte-e4e5aadb-82f1-4a80-92b4-255c55503370" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-e4e5aadb-82f1-4a80-92b4-255c55503370" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] snapshot: edd18926-d107-4fc9-bf59-feeec58bfbdd, volume: e4e5aadb-82f1-4a80-92b4-255c55503370, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacdbf3e-274c-4cdc-9e06-c8acb50226b0]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:51 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd Jul 06 12:13:51 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:52 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd" returned: 0 in 1.023s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-614018a5-f461-48ef-a279-c1efdd845e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:13:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:13:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc761d2-db43-4dbb-8085-440c0b1564e4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:13:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:52 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 Jul 06 12:13:52 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:13:53 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Jul 06 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95" returned: 0 in 1.356s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:13:53 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:13:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:13:53 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370 Jul 06 12:13:53 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:00 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370" returned: 0 in 7.213s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:00 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a71d7e-5cd5-49da-8574-0f12d207c528]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:00 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 Jul 06 12:14:00 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:01 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:INSERT=7,cinder:UPDATE=29,cinder:SELECT=21,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:01 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=22,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:02 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95" returned: 0 in 1.370s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:02 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95, size 1024.00 MB, duration 7.21 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:14:02 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Converted 1024.00 MB image at 141.93 MB/s Jul 06 12:14:02 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370 is being set with open permissions: ugo+rw Jul 06 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:02 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370 Jul 06 12:14:02 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:02 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370" returned: 0 in 0.783s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-e4e5aadb-82f1-4a80-92b4-255c55503370" released by "_copy_volume_from_snapshot" :: held 11.906s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-edd18926-d107-4fc9-bf59-feeec58bfbdd-e4e5aadb-82f1-4a80-92b4-255c55503370" released by "_create_volume_from_snapshot" :: held 11.959s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.989s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0928cbcf-5af8-4a7d-b2d8-9efac3e76f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e5aadb-82f1-4a80-92b4-255c55503370', 'volume_size': 1, 'snapshot_id': 'edd18926-d107-4fc9-bf59-feeec58bfbdd'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5466e21-e289-4b9e-9b95-0c0794c4640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:03 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Volume volume-e4e5aadb-82f1-4a80-92b4-255c55503370 (e4e5aadb-82f1-4a80-92b4-255c55503370): created successfully Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5466e21-e289-4b9e-9b95-0c0794c4640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Flow 'volume_create_manager' (a46d6294-49a3-4993-8d7e-d22b7ee87ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4076b261-b5ca-4ee7-a712-ddc161ff6009 tempest-VolumesDeleteCascade-1367877999 None] Created volume successfully. Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-614018a5-f461-48ef-a279-c1efdd845e95-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-614018a5-f461-48ef-a279-c1efdd845e95-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Performing cascade delete. {{(pid=86561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-edd18926-d107-4fc9-bf59-feeec58bfbdd-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-edd18926-d107-4fc9-bf59-feeec58bfbdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-quobyte-614018a5-f461-48ef-a279-c1efdd845e95" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-614018a5-f461-48ef-a279-c1efdd845e95" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-quobyte-edd18926-d107-4fc9-bf59-feeec58bfbdd" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-edd18926-d107-4fc9-bf59-feeec58bfbdd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Deleting offline snapshot edd18926-d107-4fc9-bf59-feeec58bfbdd of volume 614018a5-f461-48ef-a279-c1efdd845e95 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] snapshot_file for this snap is: volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3129c0-2950-4a72-b5fe-6860b0c45b83]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:04 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd Jul 06 12:14:04 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:05 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd" returned: 0 in 1.187s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-614018a5-f461-48ef-a279-c1efdd845e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:14:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e72ef17-82f0-4319-912b-97be52c51d72]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:05 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 Jul 06 12:14:05 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:06 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95" returned: 0 in 0.994s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:06 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd Jul 06 12:14:06 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:07 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd" returned: 0 in 0.945s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:07 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd Jul 06 12:14:07 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:08 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95.edd18926-d107-4fc9-bf59-feeec58bfbdd" returned: 0 in 1.021s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-edd18926-d107-4fc9-bf59-feeec58bfbdd" released by "_delete_snapshot" :: held 4.291s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-614018a5-f461-48ef-a279-c1efdd845e95" released by "delete_snapshot" :: held 4.324s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Created reservations ['45adc6a8-38c6-436a-b85a-ba7758c4ddf0', 'c75aaf1f-33c9-40f7-878d-c18d22262c55', '98b0df70-79f7-4679-b501-02eda0385fbb', '34b2e288-739c-4721-a9fa-361fe0cebe6f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Delete snapshot completed successfully. Jul 06 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-edd18926-d107-4fc9-bf59-feeec58bfbdd-delete_snapshot" released by "delete_snapshot" :: held 4.625s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Snapshots deleted, issuing volume delete {{(pid=86561) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-quobyte-614018a5-f461-48ef-a279-c1efdd845e95" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-614018a5-f461-48ef-a279-c1efdd845e95" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d50ac0-dcd3-40fe-b214-2e9cb140a888]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:08 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 Jul 06 12:14:08 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:09 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95" returned: 0 in 1.164s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:09 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95 Jul 06 12:14:09 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:10 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-614018a5-f461-48ef-a279-c1efdd845e95" returned: 0 in 0.918s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-614018a5-f461-48ef-a279-c1efdd845e95" released by "delete_volume" :: held 2.180s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Created reservations ['5a3b27d1-be78-429f-9183-85a95915e8d6', 'dacf975e-55f3-4305-a7b2-d5b4e4dd6b83', 'f83511e8-4b3b-4629-be8d-12aca382f509', '6edc6b73-23cb-4e92-b042-73b6def1e6e8'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:11 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:14:11 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-e4e5aadb-82f1-4a80-92b4-255c55503370-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-e4e5aadb-82f1-4a80-92b4-255c55503370-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "cinder-quobyte-e4e5aadb-82f1-4a80-92b4-255c55503370" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:12 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.492s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-e4e5aadb-82f1-4a80-92b4-255c55503370" acquired by "delete_volume" :: waited 0.089s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Deleted volume successfully. Jul 06 12:14:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[55053c4a-356d-4c6d-a7d5-e03af86d1d83]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-650499c9-8217-4c87-ad4d-47761ceae188 tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-614018a5-f461-48ef-a279-c1efdd845e95-delete_volume" released by "delete_volume" :: held 8.822s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:12 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370 Jul 06 12:14:12 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:13 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370" returned: 0 in 1.320s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:13 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370 Jul 06 12:14:13 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:15 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e4e5aadb-82f1-4a80-92b4-255c55503370" returned: 0 in 1.217s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-quobyte-e4e5aadb-82f1-4a80-92b4-255c55503370" released by "delete_volume" :: held 2.677s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Created reservations ['91922fb3-0ae1-4450-bcc0-0b44544789d8', '69d5f401-72b1-4b45-b157-60e0979dc827', '29bef377-ebc9-44c8-a302-cb32d6b57e44', '04bc16f5-dfda-4968-96c9-d00fc8fba2af'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:15 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:14:15 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:16 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.917s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:16 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Deleted volume successfully. Jul 06 12:14:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0f9147af-1a1a-4c5d-9ade-b72cbb68a96c tempest-VolumesDeleteCascade-1367877999 None] Lock "cinder-e4e5aadb-82f1-4a80-92b4-255c55503370-delete_volume" released by "delete_volume" :: held 4.073s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:25 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=22,cinder:SELECT=14,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:26 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=18,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=7 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Flow 'volume_create_manager' (51f9b039-8741-4c48-b038-1d3c4cf5f657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8299aa23-5a0c-4a2f-892b-25f24e6613c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8299aa23-5a0c-4a2f-892b-25f24e6613c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-920674041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a87cd3-c2e7-4972-b431-561ee9124637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aadeaf2f2b94bebbce29649f11046ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:27Z,use_quota=True,user_id='4ebcbfc0fae84ee99b14c24f529fc847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4965c2c3-bcd1-41ff-b7db-965a4d8043a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4965c2c3-bcd1-41ff-b7db-965a4d8043a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de64df5-b30c-40f9-950d-58bd07e0ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de64df5-b30c-40f9-950d-58bd07e0ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a87cd3-c2e7-4972-b431-561ee9124637', 'volume_name': 'volume-37a87cd3-c2e7-4972-b431-561ee9124637', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03792b27-f118-4302-ba7a-183e35ad0a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03792b27-f118-4302-ba7a-183e35ad0a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804c5e1e-aa12-4356-b498-7620e2e7b27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Volume 37a87cd3-c2e7-4972-b431-561ee9124637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a87cd3-c2e7-4972-b431-561ee9124637', 'volume_size': 1} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-920674041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a87cd3-c2e7-4972-b431-561ee9124637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aadeaf2f2b94bebbce29649f11046ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:27Z,use_quota=True,user_id='4ebcbfc0fae84ee99b14c24f529fc847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Creating volume 37a87cd3-c2e7-4972-b431-561ee9124637 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:27 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:14:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:27 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637 1073741824 Jul 06 12:14:27 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:28 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637 1073741824" returned: 0 in 1.109s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:28 devstack sudo[91738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637 Jul 06 12:14:28 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:29 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637" returned: 0 in 1.137s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] <== create_volume: return (2312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804c5e1e-aa12-4356-b498-7620e2e7b27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a87cd3-c2e7-4972-b431-561ee9124637', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0549b3cf-e59c-4e88-ab46-9fbc2c974913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Volume volume-37a87cd3-c2e7-4972-b431-561ee9124637 (37a87cd3-c2e7-4972-b431-561ee9124637): created successfully Jul 06 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0549b3cf-e59c-4e88-ab46-9fbc2c974913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Flow 'volume_create_manager' (51f9b039-8741-4c48-b038-1d3c4cf5f657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-49375675-2dfe-4f73-a695-a1588f338c99 tempest-VolumesTransfersV355Test-1692581779 None] Created volume successfully. Jul 06 12:14:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c49fe292-2677-430d-9af9-7accc300f4e0 tempest-VolumesTransfersV355Test-1049733320 None] Transfer volume completed successfully. Jul 06 12:14:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:14:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:32 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:14:32 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Acquiring lock "cinder-37a87cd3-c2e7-4972-b431-561ee9124637-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Lock "cinder-37a87cd3-c2e7-4972-b431-561ee9124637-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Acquiring lock "cinder-quobyte-37a87cd3-c2e7-4972-b431-561ee9124637" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Lock "cinder-quobyte-37a87cd3-c2e7-4972-b431-561ee9124637" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24b0efe-9ef7-4900-9f0b-6739ddbf32e8]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:33 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637 Jul 06 12:14:33 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:34 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.465s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:34 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:14:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 8 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:14:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:14:35 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637" returned: 0 in 1.807s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:35 devstack sudo[91758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637 Jul 06 12:14:35 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:36 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37a87cd3-c2e7-4972-b431-561ee9124637" returned: 0 in 1.230s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Lock "cinder-quobyte-37a87cd3-c2e7-4972-b431-561ee9124637" released by "delete_volume" :: held 3.130s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:36 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Created reservations ['6e9e89bf-72c7-4929-9e8f-f2330dc63e27', 'b6c76aed-1070-4b97-8323-c8b65a9737b5', '263a546b-4928-4b4c-9b91-3b6c9c112a56', '9e376348-acad-4cb9-8639-27ef72ca7aad'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:36 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:14:36 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Flow 'volume_create_manager' (3e62b885-e2ef-4e8f-87d7-26e1e7736f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd2bb43-4711-44a3-991a-9d93259a2b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd2bb43-4711-44a3-991a-9d93259a2b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-595409218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ecece4-5fbb-471a-8f2b-94d60d8570ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aadeaf2f2b94bebbce29649f11046ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:38Z,use_quota=True,user_id='4ebcbfc0fae84ee99b14c24f529fc847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdac722-da05-4ec2-b34c-5cfe15687590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdac722-da05-4ec2-b34c-5cfe15687590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:37 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c4d105-77ef-4eea-8cbe-8c52ba7b2fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c4d105-77ef-4eea-8cbe-8c52ba7b2fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ecece4-5fbb-471a-8f2b-94d60d8570ec', 'volume_name': 'volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724deccf-de92-46d4-8861-ac840f321af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724deccf-de92-46d4-8861-ac840f321af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449fed70-e3f7-4fb0-95d2-51e03d89e58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:37 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Volume 78ecece4-5fbb-471a-8f2b-94d60d8570ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec', 'volume_size': 1} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-595409218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ecece4-5fbb-471a-8f2b-94d60d8570ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aadeaf2f2b94bebbce29649f11046ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:38Z,use_quota=True,user_id='4ebcbfc0fae84ee99b14c24f529fc847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Creating volume 78ecece4-5fbb-471a-8f2b-94d60d8570ec {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:37 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.124s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:37 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec 1073741824 Jul 06 12:14:37 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Deleted volume successfully. Jul 06 12:14:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-56020bb7-011e-4d1a-8bef-66bbbc0ff278 tempest-VolumesTransfersV355Test-743338105 None] Lock "cinder-37a87cd3-c2e7-4972-b431-561ee9124637-delete_volume" released by "delete_volume" :: held 4.585s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:39 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec 1073741824" returned: 0 in 1.409s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:39 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec Jul 06 12:14:39 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:40 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec" returned: 0 in 0.906s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] <== create_volume: return (2384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:14:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.387s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449fed70-e3f7-4fb0-95d2-51e03d89e58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df10b6c5-3b93-49e0-95aa-5fdeca4acd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:40 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Volume volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec (78ecece4-5fbb-471a-8f2b-94d60d8570ec): created successfully Jul 06 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df10b6c5-3b93-49e0-95aa-5fdeca4acd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Flow 'volume_create_manager' (3e62b885-e2ef-4e8f-87d7-26e1e7736f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:40 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6980cbc4-9ece-4364-8c1e-79ae8a45c953 tempest-VolumesTransfersV355Test-1692581779 None] Created volume successfully. Jul 06 12:14:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Acquiring lock "cinder-78ecece4-5fbb-471a-8f2b-94d60d8570ec-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Lock "cinder-78ecece4-5fbb-471a-8f2b-94d60d8570ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Acquiring lock "cinder-quobyte-78ecece4-5fbb-471a-8f2b-94d60d8570ec" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Lock "cinder-quobyte-78ecece4-5fbb-471a-8f2b-94d60d8570ec" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3515b294-fffd-4fd3-b396-07d7aaba6689]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:41 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec Jul 06 12:14:41 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:42 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec" returned: 0 in 1.117s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:42 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec Jul 06 12:14:42 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:43 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-78ecece4-5fbb-471a-8f2b-94d60d8570ec" returned: 0 in 0.697s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Lock "cinder-quobyte-78ecece4-5fbb-471a-8f2b-94d60d8570ec" released by "delete_volume" :: held 1.863s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Created reservations ['e7ba71a0-a6d5-4bc1-bb1e-d5e010073c96', '9857a4c5-ed9d-4532-921a-e9c4e4df8662', '35a27000-6784-4699-8648-395b704a07fc', '23442254-2173-4080-857a-e997369cf114'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:43 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:14:43 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:44 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.833s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:14:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Deleted volume successfully. Jul 06 12:14:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e110b598-743f-4e84-97f6-1627f1137dc6 tempest-VolumesTransfersV355Test-743338105 None] Lock "cinder-78ecece4-5fbb-471a-8f2b-94d60d8570ec-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:53 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=20,cinder:SELECT=14,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:54 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=15,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:14:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Acquiring lock "cinder-03ffc89a-181d-47b1-8193-58b64cce1ae5-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Lock "cinder-03ffc89a-181d-47b1-8193-58b64cce1ae5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Acquiring lock "cinder-quobyte-03ffc89a-181d-47b1-8193-58b64cce1ae5" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:14:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Lock "cinder-quobyte-03ffc89a-181d-47b1-8193-58b64cce1ae5" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:14:55 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c820ba-8c29-4393-b469-d6e41c7a2dc9]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:14:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:55 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5 Jul 06 12:14:55 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Flow 'volume_create_manager' (1a3f38e7-c26c-497a-98d8-8682bc45f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7405d202-b35e-4b67-9447-664068c4e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7405d202-b35e-4b67-9447-664068c4e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-488604864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9348dc3b1ff24161954e6d831fe11ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:56Z,use_quota=True,user_id='c2161eaa1dfc4fbebe2d2de4c28c31ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff46050-93a3-40ea-a715-eb623e51260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff46050-93a3-40ea-a715-eb623e51260a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfce6bb-c034-45dc-afa0-e47f410fc57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfce6bb-c034-45dc-afa0-e47f410fc57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7', 'volume_name': 'volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ef8a2d-5f05-4783-86bd-9b608a2c614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ef8a2d-5f05-4783-86bd-9b608a2c614e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:14:56 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538e73a7-3ade-4bea-8307-9005d4d81b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:14:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Volume fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7', 'volume_size': 1} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-488604864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9348dc3b1ff24161954e6d831fe11ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:14:56Z,use_quota=True,user_id='c2161eaa1dfc4fbebe2d2de4c28c31ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Creating volume fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:14:56 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5" returned: 0 in 1.447s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:56 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7 1073741824 Jul 06 12:14:56 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:56 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5 Jul 06 12:14:56 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:58 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-03ffc89a-181d-47b1-8193-58b64cce1ae5" returned: 0 in 1.596s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Lock "cinder-quobyte-03ffc89a-181d-47b1-8193-58b64cce1ae5" released by "delete_volume" :: held 3.114s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:14:58 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Created reservations ['9932babe-6c22-49ef-9ad5-f113ed3c2b31', '5d2a273d-ea68-4ca2-9f66-4595cd1da329', 'd8e2af85-5f89-49b2-a0fc-b9377d9066fa', '225aeb7f-3fc3-4b2f-b1a9-6f2755af0644'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:14:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:14:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:14:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:14:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:14:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:14:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:58 devstack sudo[92007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:14:58 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:14:58 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Jul 06 12:14:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7 1073741824" returned: 0 in 2.095s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:14:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:14:58 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7 Jul 06 12:14:58 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:00 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7" returned: 0 in 1.699s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] <== create_volume: return (3885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.906s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538e73a7-3ade-4bea-8307-9005d4d81b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57109fc6-ab70-47d5-956f-207f53017369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:00 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Volume volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7 (fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7): created successfully Jul 06 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57109fc6-ab70-47d5-956f-207f53017369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:00 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Flow 'volume_create_manager' (1a3f38e7-c26c-497a-98d8-8682bc45f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 2.371s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Deleted volume successfully. Jul 06 12:15:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c4a73706-b05b-4fe7-a741-ecdc77d56956 tempest-VolumesTransfersV357Test-1137488721 None] Created volume successfully. Jul 06 12:15:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-151d3583-4b58-48bf-9733-959c0059fab2 tempest-AttachVolumeShelveTestJSON-1458163877 None] Lock "cinder-03ffc89a-181d-47b1-8193-58b64cce1ae5-delete_volume" released by "delete_volume" :: held 5.929s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (b6bf22a3-2c69-40ed-bacb-dcb79cf3845d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8c93c4-926c-4f67-97af-ed741e566f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8c93c4-926c-4f67-97af-ed741e566f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1726542861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea82fdf9-8278-4994-8085-ee141292f332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:01Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45eb9fe0-2530-45f1-a25c-24bef737a711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45eb9fe0-2530-45f1-a25c-24bef737a711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3ffc38-361e-4134-9b8f-d29f38dbc2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3ffc38-361e-4134-9b8f-d29f38dbc2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea82fdf9-8278-4994-8085-ee141292f332', 'volume_name': 'volume-ea82fdf9-8278-4994-8085-ee141292f332', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fbd613-e367-4443-96c9-2d4b8e78f95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fbd613-e367-4443-96c9-2d4b8e78f95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa8e4e4-aaa9-414d-af28-9a7c2082aa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Volume ea82fdf9-8278-4994-8085-ee141292f332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea82fdf9-8278-4994-8085-ee141292f332', 'volume_size': 1} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1726542861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea82fdf9-8278-4994-8085-ee141292f332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:01Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Creating volume ea82fdf9-8278-4994-8085-ee141292f332 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:01 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:15:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:01 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332 1073741824 Jul 06 12:15:01 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-26357fad-012f-4a02-9c9c-69ef07d8ee69 tempest-VolumesTransfersV357Test-1828951388 None] Transfer volume completed successfully. Jul 06 12:15:04 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332 1073741824" returned: 0 in 2.284s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:04 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332 Jul 06 12:15:04 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Acquiring lock "cinder-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Lock "cinder-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Acquiring lock "cinder-quobyte-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Lock "cinder-quobyte-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7" acquired by "delete_volume" :: waited 0.054s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[990dcaf9-b1ef-4469-8373-259ac3ec8e47]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:05 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7 Jul 06 12:15:05 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:06 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332" returned: 0 in 2.033s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] <== create_volume: return (4466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.468s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa8e4e4-aaa9-414d-af28-9a7c2082aa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea82fdf9-8278-4994-8085-ee141292f332', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae00d9c8-a60a-4843-be63-aa4811c036e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Volume volume-ea82fdf9-8278-4994-8085-ee141292f332 (ea82fdf9-8278-4994-8085-ee141292f332): created successfully Jul 06 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae00d9c8-a60a-4843-be63-aa4811c036e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (b6bf22a3-2c69-40ed-bacb-dcb79cf3845d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-54b69d30-a6b2-43d6-97fc-1f526151044e tempest-VolumesActionsTest-1626448900 None] Created volume successfully. Jul 06 12:15:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-86658bb1-490b-408b-ab50-712f5b8d90dd tempest-VolumesActionsTest-1626448900 None] Acquiring lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332" by "attach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-86658bb1-490b-408b-ab50-712f5b8d90dd tempest-VolumesActionsTest-1626448900 None] Lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332" acquired by "attach_volume" :: waited 0.100s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-86658bb1-490b-408b-ab50-712f5b8d90dd tempest-VolumesActionsTest-1626448900 None] Attaching volume ea82fdf9-8278-4994-8085-ee141292f332 to instance 3b9fb20a-c4e5-4ed6-a232-9fa0f538c34c at mountpoint /dev/vdb on host None. Jul 06 12:15:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-86658bb1-490b-408b-ab50-712f5b8d90dd tempest-VolumesActionsTest-1626448900 None] Attach volume completed successfully. Jul 06 12:15:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-86658bb1-490b-408b-ab50-712f5b8d90dd tempest-VolumesActionsTest-1626448900 None] Lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332" released by "attach_volume" :: held 0.311s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:07 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7" returned: 0 in 2.850s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:07 devstack sudo[92072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7 Jul 06 12:15:07 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5d46db3a-844f-42c3-8963-5bccaf93fc2b tempest-VolumesActionsTest-1627363050 None] Terminate volume connection completed successfully. Jul 06 12:15:09 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7" returned: 0 in 1.840s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Lock "cinder-quobyte-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7" released by "delete_volume" :: held 4.872s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Created reservations ['960e9247-095a-4b42-9381-f46058db54c3', '33bf9757-a324-451f-9197-33f7adcf1b18', '8e7f3799-bf2d-48ee-8ee3-5c12b3852bf4', 'befe6fc7-ce9c-4a70-b4fc-cc2c5cd75f02'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5d46db3a-844f-42c3-8963-5bccaf93fc2b tempest-VolumesActionsTest-1627363050 None] Acquiring lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332-detach_volume" by "detach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5d46db3a-844f-42c3-8963-5bccaf93fc2b tempest-VolumesActionsTest-1627363050 None] Lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5d46db3a-844f-42c3-8963-5bccaf93fc2b tempest-VolumesActionsTest-1627363050 None] Detaching volume ea82fdf9-8278-4994-8085-ee141292f332 from instance 3b9fb20a-c4e5-4ed6-a232-9fa0f538c34c. Jul 06 12:15:09 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:15:09 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5d46db3a-844f-42c3-8963-5bccaf93fc2b tempest-VolumesActionsTest-1627363050 None] Detach volume completed successfully. Jul 06 12:15:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5d46db3a-844f-42c3-8963-5bccaf93fc2b tempest-VolumesActionsTest-1627363050 None] Lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332-detach_volume" released by "detach_volume" :: held 0.212s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c30406b3-666d-474b-8266-92f057f69061 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332-detach_volume" by "detach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c30406b3-666d-474b-8266-92f057f69061 tempest-VolumesActionsTest-1626448900 None] Lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332-detach_volume" acquired by "detach_volume" :: waited 0.072s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c30406b3-666d-474b-8266-92f057f69061 tempest-VolumesActionsTest-1626448900 None] Volume detach called, but volume not attached. Jul 06 12:15:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c30406b3-666d-474b-8266-92f057f69061 tempest-VolumesActionsTest-1626448900 None] Lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:11 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 2.028s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:11 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Deleted volume successfully. Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f7f984c3-f0e4-4285-a583-82ef2d3268f5 tempest-VolumesTransfersV357Test-1325213487 None] Lock "cinder-fb5098ed-be06-4b16-b86e-1f7eb7cfc1f7-delete_volume" released by "delete_volume" :: held 7.479s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Flow 'volume_create_manager' (2d444897-0a3e-420a-b783-f35d075405d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cbaf0c-d127-49ad-ace6-99887cfe9217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cbaf0c-d127-49ad-ace6-99887cfe9217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1883040338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93091f32-ba42-4bb0-8859-f890dbc4bfac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9348dc3b1ff24161954e6d831fe11ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:12Z,use_quota=True,user_id='c2161eaa1dfc4fbebe2d2de4c28c31ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff23e156-3d7a-4a56-b387-8c0ff06818f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff23e156-3d7a-4a56-b387-8c0ff06818f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458d1384-998f-4542-a62f-e946f7e2ae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (458d1384-998f-4542-a62f-e946f7e2ae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93091f32-ba42-4bb0-8859-f890dbc4bfac', 'volume_name': 'volume-93091f32-ba42-4bb0-8859-f890dbc4bfac', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23dab394-8185-4800-9b33-9dc8a1d82a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23dab394-8185-4800-9b33-9dc8a1d82a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f96496-a4c1-49bb-a4c5-5ff415974c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Volume 93091f32-ba42-4bb0-8859-f890dbc4bfac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93091f32-ba42-4bb0-8859-f890dbc4bfac', 'volume_size': 1} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1883040338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93091f32-ba42-4bb0-8859-f890dbc4bfac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9348dc3b1ff24161954e6d831fe11ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:12Z,use_quota=True,user_id='c2161eaa1dfc4fbebe2d2de4c28c31ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Creating volume 93091f32-ba42-4bb0-8859-f890dbc4bfac {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:12 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:12 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac 1073741824 Jul 06 12:15:12 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "cinder-quobyte-ea82fdf9-8278-4994-8085-ee141292f332" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Lock "cinder-quobyte-ea82fdf9-8278-4994-8085-ee141292f332" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a90aa8-eb7a-4406-a627-2d91953baf1a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:12 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332 Jul 06 12:15:12 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:13 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac 1073741824" returned: 0 in 1.326s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:13 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac Jul 06 12:15:13 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:13 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332" returned: 0 in 1.310s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:14 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332 Jul 06 12:15:14 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:14 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac" returned: 0 in 0.813s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f96496-a4c1-49bb-a4c5-5ff415974c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93091f32-ba42-4bb0-8859-f890dbc4bfac', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa21f378-e8f7-46fb-9fef-a0271c2c4a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:14 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Volume volume-93091f32-ba42-4bb0-8859-f890dbc4bfac (93091f32-ba42-4bb0-8859-f890dbc4bfac): created successfully Jul 06 12:15:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa21f378-e8f7-46fb-9fef-a0271c2c4a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Flow 'volume_create_manager' (2d444897-0a3e-420a-b783-f35d075405d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d20a37a1-3dcd-4c24-a6e6-697a4d4b6d1f tempest-VolumesTransfersV357Test-1137488721 None] Created volume successfully. Jul 06 12:15:15 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ea82fdf9-8278-4994-8085-ee141292f332" returned: 0 in 1.083s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Lock "cinder-quobyte-ea82fdf9-8278-4994-8085-ee141292f332" released by "delete_volume" :: held 2.470s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:15 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Created reservations ['831ae095-02d8-4bd9-94b1-feb7fb0791a1', '96db865d-87e5-41eb-b0e1-7f61b01c2c90', '9bca5a88-a66d-4b16-8155-109f5932c051', '488db51b-6f25-4702-a181-7c1bbb29a074'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:15 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:15:15 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Acquiring lock "cinder-93091f32-ba42-4bb0-8859-f890dbc4bfac-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Lock "cinder-93091f32-ba42-4bb0-8859-f890dbc4bfac-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Acquiring lock "cinder-quobyte-93091f32-ba42-4bb0-8859-f890dbc4bfac" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Lock "cinder-quobyte-93091f32-ba42-4bb0-8859-f890dbc4bfac" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:16 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfba3e20-1873-4d91-8b2a-a3a9ac4bb370]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:16 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.083s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Deleted volume successfully. Jul 06 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e38c6c93-d849-4140-bd2b-ed94645a5c49 tempest-VolumesActionsTest-1626448900 None] Lock "cinder-ea82fdf9-8278-4994-8085-ee141292f332-delete_volume" released by "delete_volume" :: held 3.975s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:16 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac Jul 06 12:15:16 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-21cdf2bc-e927-438d-b860-a83e3fed0bcc tempest-BackendsCapabilitiesAdminTestsJSON-1065914294 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7288703918457, 'free_capacity_gb': 1775.7288703918457, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86561) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 12:15:17 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac" returned: 0 in 1.008s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:17 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac Jul 06 12:15:17 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d66a2d99-b416-4a0d-b0a4-ac9f8c8ac708 tempest-BackendsCapabilitiesAdminTestsJSON-1065914294 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7288703918457, 'free_capacity_gb': 1775.7288703918457, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86561) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 12:15:18 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-93091f32-ba42-4bb0-8859-f890dbc4bfac" returned: 0 in 1.149s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Lock "cinder-quobyte-93091f32-ba42-4bb0-8859-f890dbc4bfac" released by "delete_volume" :: held 2.238s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:18 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Created reservations ['f576733f-3ecd-4109-8aa0-625f7fe5114e', '338b1899-0047-43a5-b2ba-ca462ebe5701', '94ce0e61-09e1-47b6-8391-6859811efc49', '39f44b56-e4b8-4566-8db9-221114bb53ec'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:18 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:15:18 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:19 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.031s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:19 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Deleted volume successfully. Jul 06 12:15:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-15260630-34e3-4f1c-a670-017122b22509 tempest-VolumesTransfersV357Test-1325213487 None] Lock "cinder-93091f32-ba42-4bb0-8859-f890dbc4bfac-delete_volume" released by "delete_volume" :: held 3.703s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (e488d6bc-ce46-40de-a32d-deb58c77235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6203fa3d-d224-4e17-a4e4-27f90b4da699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6203fa3d-d224-4e17-a4e4-27f90b4da699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2056662756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf92a4a2-f53b-4198-8b5f-4d214185eab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:25Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c859d71-90a9-4d61-9767-cfe358ad042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c859d71-90a9-4d61-9767-cfe358ad042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c195b3fc-ea5d-45d1-988c-dab8a58f9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c195b3fc-ea5d-45d1-988c-dab8a58f9c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf92a4a2-f53b-4198-8b5f-4d214185eab9', 'volume_name': 'volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b13568-89e4-4577-aa62-9d62a0f57dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b13568-89e4-4577-aa62-9d62a0f57dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71c6ddc-604a-45d7-a5de-dbfcbb4103d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:24 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Volume bf92a4a2-f53b-4198-8b5f-4d214185eab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9', 'volume_size': 1} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2056662756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf92a4a2-f53b-4198-8b5f-4d214185eab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:25Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Creating volume bf92a4a2-f53b-4198-8b5f-4d214185eab9 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:24 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:15:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:24 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9 1073741824 Jul 06 12:15:24 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:26 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9 1073741824" returned: 0 in 1.145s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:26 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9 Jul 06 12:15:26 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:27 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9" returned: 0 in 0.887s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71c6ddc-604a-45d7-a5de-dbfcbb4103d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b58646-4792-471f-a980-73b15f2a047e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Volume volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9 (bf92a4a2-f53b-4198-8b5f-4d214185eab9): created successfully Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b58646-4792-471f-a980-73b15f2a047e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (e488d6bc-ce46-40de-a32d-deb58c77235a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ea5ab2dc-8659-4ba1-836e-16131fd79545 tempest-VolumesActionsTest-1626448900 None] Created volume successfully. Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Flow 'volume_create_manager' (2d27fd61-b041-43cc-9de5-ecad9922fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64caddf-6b31-47ce-adee-5e3ff5e97d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64caddf-6b31-47ce-adee-5e3ff5e97d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-155872908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105b8a49-2ba2-4dc7-a04a-12c2c60b709a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15002e1a9a74284a3fe94944a362793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:28Z,use_quota=True,user_id='1c39a400b6a74934b6e7d4303ec62109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fe5aff-b218-4337-a057-cf4c8f652338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fe5aff-b218-4337-a057-cf4c8f652338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ffd468-1929-4427-8a3c-92df8eefb345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ffd468-1929-4427-8a3c-92df8eefb345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '105b8a49-2ba2-4dc7-a04a-12c2c60b709a', 'volume_name': 'volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a', 'volume_size': 2}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df6a884-9c34-481a-ad9f-3a7e7c50f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df6a884-9c34-481a-ad9f-3a7e7c50f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8025bdc4-2cb1-44e9-bd5f-85eebb55bdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Volume 105b8a49-2ba2-4dc7-a04a-12c2c60b709a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a', 'volume_size': 2} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-155872908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105b8a49-2ba2-4dc7-a04a-12c2c60b709a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a15002e1a9a74284a3fe94944a362793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:28Z,use_quota=True,user_id='1c39a400b6a74934b6e7d4303ec62109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Creating volume 105b8a49-2ba2-4dc7-a04a-12c2c60b709a {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:27 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:15:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a 2147483648 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:27 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a 2147483648 Jul 06 12:15:27 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "cinder-bf92a4a2-f53b-4198-8b5f-4d214185eab9-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-bf92a4a2-f53b-4198-8b5f-4d214185eab9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "cinder-quobyte-bf92a4a2-f53b-4198-8b5f-4d214185eab9" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-quobyte-bf92a4a2-f53b-4198-8b5f-4d214185eab9" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a623d9d-0e8e-458c-93eb-4a80df83f44f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:28 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9 Jul 06 12:15:28 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:29 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a 2147483648" returned: 0 in 1.222s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:29 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a Jul 06 12:15:29 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Flow 'volume_create_manager' (d73e50ae-d8d1-46cd-9879-76807e2432fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:29 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62affae-4148-42ad-beb9-04c2feb282d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9" returned: 0 in 1.365s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62affae-4148-42ad-beb9-04c2feb282d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2117477583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d8c006-3546-479e-a62e-8b504ebf5256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8085737e6dbd48da8529322a92b4fdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:30Z,use_quota=True,user_id='54a623346f2e468dae020fbcbd96ae3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3987e0-3636-4fc0-83fc-2d8b57893e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3987e0-3636-4fc0-83fc-2d8b57893e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:29 devstack sudo[92217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9 Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e91f66-9aad-4ebc-a7d1-5c56fd96e4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:29 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e91f66-9aad-4ebc-a7d1-5c56fd96e4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d8c006-3546-479e-a62e-8b504ebf5256', 'volume_name': 'volume-79d8c006-3546-479e-a62e-8b504ebf5256', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc6dde7-8ad0-423c-9dc2-442694378a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc6dde7-8ad0-423c-9dc2-442694378a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfafd84-2589-4747-9b72-cb8741d57534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Volume 79d8c006-3546-479e-a62e-8b504ebf5256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d8c006-3546-479e-a62e-8b504ebf5256', 'volume_size': 1} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:29 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a" returned: 0 in 0.892s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.106s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2117477583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d8c006-3546-479e-a62e-8b504ebf5256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8085737e6dbd48da8529322a92b4fdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:30Z,use_quota=True,user_id='54a623346f2e468dae020fbcbd96ae3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Creating volume 79d8c006-3546-479e-a62e-8b504ebf5256 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:29 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:15:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8025bdc4-2cb1-44e9-bd5f-85eebb55bdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a', 'volume_size': 2}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510e2cc9-f61f-4ef6-8939-1819108b93fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:30 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256 1073741824 Jul 06 12:15:30 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:30 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Volume volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a (105b8a49-2ba2-4dc7-a04a-12c2c60b709a): created successfully Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510e2cc9-f61f-4ef6-8939-1819108b93fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Flow 'volume_create_manager' (2d27fd61-b041-43cc-9de5-ecad9922fc21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3f4a4ed0-6e4d-4033-a0e9-5818376b2557 tempest-VolumesCloneNegativeTest-1233436440 None] Created volume successfully. Jul 06 12:15:30 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-bf92a4a2-f53b-4198-8b5f-4d214185eab9" returned: 0 in 0.969s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-quobyte-bf92a4a2-f53b-4198-8b5f-4d214185eab9" released by "delete_volume" :: held 2.400s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Created reservations ['681d67d0-bb7c-48de-8b67-7e5777ab4456', '1fe6d8e5-5c66-455d-a1a0-f85494fde2f6', '87021c97-a10f-4b6b-a66d-9eb25e254e17', '9ca65928-e552-4478-b0bc-81036d79cfc7'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:30 devstack sudo[92226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:15:30 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Acquiring lock "cinder-105b8a49-2ba2-4dc7-a04a-12c2c60b709a-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:31 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256 1073741824" returned: 0 in 1.275s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Lock "cinder-105b8a49-2ba2-4dc7-a04a-12c2c60b709a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Acquiring lock "cinder-quobyte-105b8a49-2ba2-4dc7-a04a-12c2c60b709a" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:31 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256 Jul 06 12:15:31 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Lock "cinder-quobyte-105b8a49-2ba2-4dc7-a04a-12c2c60b709a" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4b6376-037d-4796-b4eb-5de4a13577ca]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:31 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a Jul 06 12:15:31 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:31 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.029s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:31 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Deleted volume successfully. Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b5ec88fe-a6d0-4da8-8cb4-7627c4e97fc4 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-bf92a4a2-f53b-4198-8b5f-4d214185eab9-delete_volume" released by "delete_volume" :: held 3.726s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:32 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256" returned: 0 in 1.059s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] <== create_volume: return (2424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfafd84-2589-4747-9b72-cb8741d57534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d8c006-3546-479e-a62e-8b504ebf5256', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93839aa-89bd-48d7-b6fc-0a9fa0f82920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:32 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Volume volume-79d8c006-3546-479e-a62e-8b504ebf5256 (79d8c006-3546-479e-a62e-8b504ebf5256): created successfully Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93839aa-89bd-48d7-b6fc-0a9fa0f82920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Flow 'volume_create_manager' (d73e50ae-d8d1-46cd-9879-76807e2432fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-df9158eb-39b8-4539-9dde-af220c4f0580 tempest-AttachVolumeTestJSON-600723819 None] Created volume successfully. Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (835ca97f-2255-4f59-827d-2033dc3b9483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf21be8-75f9-4f12-ad33-99092ecc243d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf21be8-75f9-4f12-ad33-99092ecc243d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-242805343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d5397e-11d4-4dc4-b4b6-cbab8ec2625e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:33Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:32 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a84655-65e6-43a1-9988-45769dc0166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a84655-65e6-43a1-9988-45769dc0166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84672cd5-ef8f-4075-9f22-05d60c5c311d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84672cd5-ef8f-4075-9f22-05d60c5c311d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d5397e-11d4-4dc4-b4b6-cbab8ec2625e', 'volume_name': 'volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00d177b-f1b8-4039-9f90-52b2827c9209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00d177b-f1b8-4039-9f90-52b2827c9209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a8bec4-5e96-4d4e-ab99-546dc08442d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:32 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Volume 44d5397e-11d4-4dc4-b4b6-cbab8ec2625e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e', 'volume_size': 1} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-242805343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d5397e-11d4-4dc4-b4b6-cbab8ec2625e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:33Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Creating volume 44d5397e-11d4-4dc4-b4b6-cbab8ec2625e {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:32 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a" returned: 0 in 1.313s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:32 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e 1073741824 Jul 06 12:15:32 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:32 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a Jul 06 12:15:32 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:32 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:15:32 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-53d39546-cbf4-4be8-acc3-48624c894e27 tempest-GroupsV314Test-954606303 None] Group tempest-GroupsV314Test-Group-2140134358: creating Jul 06 12:15:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-53d39546-cbf4-4be8-acc3-48624c894e27 tempest-GroupsV314Test-954606303 None] Group tempest-GroupsV314Test-Group-2140134358: created successfully Jul 06 12:15:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-53d39546-cbf4-4be8-acc3-48624c894e27 tempest-GroupsV314Test-954606303 None] Create group completed successfully. Jul 06 12:15:33 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-105b8a49-2ba2-4dc7-a04a-12c2c60b709a" returned: 0 in 0.895s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Lock "cinder-quobyte-105b8a49-2ba2-4dc7-a04a-12c2c60b709a" released by "delete_volume" :: held 2.288s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Created reservations ['fbd08adb-841a-4dce-b59d-d11954cc3f8b', 'a803a8de-8f90-44c4-a02a-22b235a87a38', '05bcfacb-3501-4197-bea9-d489468019f4', 'faa88032-aa27-4509-a9f2-6a08a68b456a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:33 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:15:33 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:33 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.081s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 8 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:15:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:15:34 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e 1073741824" returned: 0 in 1.313s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:34 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e Jul 06 12:15:34 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:34 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.006s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Deleted volume successfully. Jul 06 12:15:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d369b4b7-5b16-4682-83a7-fbc7574d901c tempest-VolumesCloneNegativeTest-1233436440 None] Lock "cinder-105b8a49-2ba2-4dc7-a04a-12c2c60b709a-delete_volume" released by "delete_volume" :: held 3.668s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:35 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e" returned: 0 in 0.947s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] <== create_volume: return (2451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.459s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a8bec4-5e96-4d4e-ab99-546dc08442d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf1d8a1-585e-4441-9110-5798cb43f04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Volume volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e (44d5397e-11d4-4dc4-b4b6-cbab8ec2625e): created successfully Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf1d8a1-585e-4441-9110-5798cb43f04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (835ca97f-2255-4f59-827d-2033dc3b9483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e6ce0253-ae2c-49c2-8f6a-3e984f8516c9 tempest-VolumesActionsTest-1626448900 None] Created volume successfully. Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Flow 'volume_create_manager' (958fbf05-66b8-4a21-828f-62a4fd8d7bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8ad203-eb07-42d3-88f5-0ad2abb90283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8ad203-eb07-42d3-88f5-0ad2abb90283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1238375495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e654d269-a2ff-4beb-9f04-70360731f302,host='devstack@QuobyteHD#QuobyteHD',id=3f69af48-1f5d-4137-b10a-ea0c77100af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b5b595cf69428d97f444f3e843cbdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:35Z,use_quota=True,user_id='f0cc971c434241e68ca5aa9b46ccbf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(581367ea-cb44-4581-bc30-d0d214f1b22b),volume_type_id=581367ea-cb44-4581-bc30-d0d214f1b22b)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9e3e06-e63e-467f-9882-d122261c0684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9e3e06-e63e-467f-9882-d122261c0684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ff70f5-dd16-4900-8ea8-bc4f3f3a64f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ff70f5-dd16-4900-8ea8-bc4f3f3a64f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f69af48-1f5d-4137-b10a-ea0c77100af7', 'volume_name': 'volume-3f69af48-1f5d-4137-b10a-ea0c77100af7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dff660-118e-4551-b7c2-4f80ec5de1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dff660-118e-4551-b7c2-4f80ec5de1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c4054d-97ad-4bd9-a8ce-ba152061224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Volume 3f69af48-1f5d-4137-b10a-ea0c77100af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f69af48-1f5d-4137-b10a-ea0c77100af7', 'volume_size': 1} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e654d269-a2ff-4beb-9f04-70360731f302,created_at=2026-07-06T10:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1238375495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e654d269-a2ff-4beb-9f04-70360731f302,host='devstack@QuobyteHD#QuobyteHD',id=3f69af48-1f5d-4137-b10a-ea0c77100af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b5b595cf69428d97f444f3e843cbdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:35Z,use_quota=True,user_id='f0cc971c434241e68ca5aa9b46ccbf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(581367ea-cb44-4581-bc30-d0d214f1b22b),volume_type_id=581367ea-cb44-4581-bc30-d0d214f1b22b)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Creating volume 3f69af48-1f5d-4137-b10a-ea0c77100af7 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:35 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:15:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:35 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 1073741824 Jul 06 12:15:35 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "cinder-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "cinder-quobyte-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-quobyte-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e982555-0470-43f4-a481-794ab2d3b1d7]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:36 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e Jul 06 12:15:36 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-9b8a7817-88f7-4670-96eb-c5a500721424 req-d24d05c5-81e5-4658-befa-cd7cc488b9e6 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:36 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 1073741824" returned: 0 in 1.386s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:36 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 Jul 06 12:15:36 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:37 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e" returned: 0 in 1.126s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:37 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e Jul 06 12:15:37 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:37 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7" returned: 0 in 0.928s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] <== create_volume: return (2377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.381s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-9b8a7817-88f7-4670-96eb-c5a500721424 req-d24d05c5-81e5-4658-befa-cd7cc488b9e6 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.058s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c4054d-97ad-4bd9-a8ce-ba152061224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f69af48-1f5d-4137-b10a-ea0c77100af7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba3d237-d909-4189-a0dc-f01861a54f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5292df8f-3176-4ad4-ba89-2e7c22fc4ff9]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-9b8a7817-88f7-4670-96eb-c5a500721424 req-d24d05c5-81e5-4658-befa-cd7cc488b9e6 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:37 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Volume volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 (3f69af48-1f5d-4137-b10a-ea0c77100af7): created successfully Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba3d237-d909-4189-a0dc-f01861a54f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Flow 'volume_create_manager' (958fbf05-66b8-4a21-828f-62a4fd8d7bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-30293fd9-2ca2-43e4-b027-1b32d7e9bd94 tempest-GroupsV314Test-954606303 None] Created volume successfully. Jul 06 12:15:38 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256 Jul 06 12:15:38 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:38 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e" returned: 0 in 0.855s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-quobyte-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e" released by "delete_volume" :: held 2.051s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Created reservations ['72b30bb6-098f-4797-a86d-ece4c16f37b1', '91ee0fe4-532b-4662-a10f-871dff3fc46a', '67ef669f-38d5-4f46-a6c7-4b77e5dc1f16', 'bc78e58f-37e5-47a9-902b-79441a73ef3c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:38 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:15:38 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:39 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-9b8a7817-88f7-4670-96eb-c5a500721424 req-d24d05c5-81e5-4658-befa-cd7cc488b9e6 tempest-AttachVolumeTestJSON-600723819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256" returned: 0 in 1.142s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-9b8a7817-88f7-4670-96eb-c5a500721424 req-d24d05c5-81e5-4658-befa-cd7cc488b9e6 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.186s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-9b8a7817-88f7-4670-96eb-c5a500721424 req-d24d05c5-81e5-4658-befa-cd7cc488b9e6 tempest-AttachVolumeTestJSON-600723819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-79d8c006-3546-479e-a62e-8b504ebf5256', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '960d8e50-391c-43ba-babf-1801fe398a3b', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:15:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-9b8a7817-88f7-4670-96eb-c5a500721424 req-d24d05c5-81e5-4658-befa-cd7cc488b9e6 tempest-AttachVolumeTestJSON-600723819 None] attachment_update completed successfully. Jul 06 12:15:39 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.982s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:15:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Deleted volume successfully. Jul 06 12:15:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8bf2383b-e3ac-4e48-b0b0-2af204a521e2 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-44d5397e-11d4-4dc4-b4b6-cbab8ec2625e-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Flow 'volume_create_manager' (2072cf00-d7c3-40a6-af9d-df61935bc93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efac5822-d902-4d04-8871-7712879cd9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efac5822-d902-4d04-8871-7712879cd9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1789327323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3efeed1-4cff-4d8a-ab52-019ac7632fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668f0f88df9c4e80bc85a87c042be8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:40Z,use_quota=True,user_id='a594eae5066449e884746a6ff4707599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644134a0-269d-43f9-a06b-20fb816725d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644134a0-269d-43f9-a06b-20fb816725d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8459e2-4f4a-4560-932d-2feb17a2e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:40 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Cloning volume 3f69af48-1f5d-4137-b10a-ea0c77100af7 to volume 1f1b484a-a996-4de1-956a-42bde5cb1de8 Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Creating offline snapshot 64809235-769c-478a-8069-372188f5be68 of volume 3f69af48-1f5d-4137-b10a-ea0c77100af7 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c26fdae-3e82-4050-bb00-0553c4a5e3e3]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:40 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 Jul 06 12:15:40 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8459e2-4f4a-4560-932d-2feb17a2e37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3efeed1-4cff-4d8a-ab52-019ac7632fbd', 'volume_name': 'volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49370bae-725c-4b96-89e7-bdb0f0473c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49370bae-725c-4b96-89e7-bdb0f0473c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47204e85-ce61-4713-8771-f45259a776f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:41 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Volume b3efeed1-4cff-4d8a-ab52-019ac7632fbd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Trying to clone b3efeed1-4cff-4d8a-ab52-019ac7632fbd from image b5606d26-431d-46eb-8401-a0b1e0a3d067 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (e1c1c683-453d-4a83-9cce-ceb4897833ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ae2adc-3c70-45e7-b3c5-a5955c87ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ae2adc-3c70-45e7-b3c5-a5955c87ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-249995009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:41Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6833b1-f95f-4eeb-be0e-8568c3a4c02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6833b1-f95f-4eeb-be0e-8568c3a4c02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4faf63-ea28-4c58-8152-3ab6a515d2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4faf63-ea28-4c58-8152-3ab6a515d2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0', 'volume_name': 'volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8da5736-df0d-461f-8316-59517b252f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8da5736-df0d-461f-8316-59517b252f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0913e0a-def9-43b3-b66b-53a636df1185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:15:41 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Volume f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0', 'volume_size': 1} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:15:41 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Image download 20.69 MB at 20.69 MB/s Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39a94c1-4b8f-4bb9-af90-5c16c722d171]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:41 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:41 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD Jul 06 12:15:41 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7" returned: 0 in 1.056s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:41 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 1G Jul 06 12:15:41 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:42 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:42 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Temporary image b5606d26-431d-46eb-8401-a0b1e0a3d067 is fetched for user a594eae5066449e884746a6ff4707599. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:15:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b1d95a-83f1-4b59-99e4-2000ec14ccb1]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:42 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD Jul 06 12:15:42 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:42 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 1G" returned: 0 in 0.938s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:42 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 Jul 06 12:15:42 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:43 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:43 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68" returned: 0 in 0.798s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:43 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:15:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:43 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 Jul 06 12:15:43 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:44 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68" returned: 0 in 0.753s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:44 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.info Jul 06 12:15:44 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:45 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.info" returned: 0 in 0.734s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:45 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:15:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:45 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.info Jul 06 12:15:45 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:45 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.info" returned: 0 in 0.785s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Acquiring lock "cinder-quobyte-1f1b484a-a996-4de1-956a-42bde5cb1de8" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Lock "cinder-quobyte-1f1b484a-a996-4de1-956a-42bde5cb1de8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] snapshot: 64809235-769c-478a-8069-372188f5be68, volume: 1f1b484a-a996-4de1-956a-42bde5cb1de8, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:15:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:46 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8a9356-a737-4696-b3a8-700d34269499]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:46 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 Jul 06 12:15:46 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:46 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68" returned: 0 in 0.950s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f69af48-1f5d-4137-b10a-ea0c77100af7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:15:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:15:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:15:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f20309-6590-4d67-ab70-c7b4239d63ba]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:47 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 Jul 06 12:15:47 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:47 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7" returned: 0 in 0.908s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:47 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:15:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:47 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8 Jul 06 12:15:47 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:53 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8" returned: 0 in 5.694s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af096d2-8d56-4a51-860b-6cb6c2f314ce]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:53 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 Jul 06 12:15:53 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:54 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=78,cinder:INSERT=21,cinder:UPDATE=85,cinder:DELETE=10 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:15:54 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=72,cinder:UPDATE=91,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:15:54 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7" returned: 0 in 1.118s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:54 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:15:54 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Converted 1024.00 MB image at 179.80 MB/s Jul 06 12:15:54 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:15:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:54 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8 Jul 06 12:15:54 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:55 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8" returned: 0 in 0.680s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Lock "cinder-quobyte-1f1b484a-a996-4de1-956a-42bde5cb1de8" released by "_copy_volume_from_snapshot" :: held 9.460s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Acquiring lock "cinder-quobyte-64809235-769c-478a-8069-372188f5be68" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:15:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Lock "cinder-quobyte-64809235-769c-478a-8069-372188f5be68" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:15:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Deleting offline snapshot 64809235-769c-478a-8069-372188f5be68 of volume 3f69af48-1f5d-4137-b10a-ea0c77100af7 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:15:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] snapshot_file for this snap is: volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:15:55 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce7550-91a8-4d99-9c12-6035eb4e520a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:55 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 Jul 06 12:15:55 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:56 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68" returned: 0 in 0.880s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f69af48-1f5d-4137-b10a-ea0c77100af7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:15:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8958efe7-5d74-4cb4-94b8-53596e949215]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:15:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:56 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 Jul 06 12:15:56 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:57 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7" returned: 0 in 1.456s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:57 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 Jul 06 12:15:57 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:58 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68" returned: 0 in 0.940s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:58 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68 Jul 06 12:15:58 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:59 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7.64809235-769c-478a-8069-372188f5be68" returned: 0 in 0.755s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Lock "cinder-quobyte-64809235-769c-478a-8069-372188f5be68" released by "_delete_snapshot" :: held 4.158s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.965s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.209s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-249995009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:41Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Creating volume f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:15:59 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:15:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:15:59 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0 1073741824 Jul 06 12:15:59 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:15:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-29d1f67f-7ecf-4b28-931e-b19c43387f8c tempest-GroupsV314Test-954606303 None] Create group from source-group-e654d269-a2ff-4beb-9f04-70360731f302 completed successfully. Jul 06 12:16:00 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0 1073741824" returned: 0 in 1.291s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:01 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0 Jul 06 12:16:01 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Acquiring lock "cinder-quobyte-1f1b484a-a996-4de1-956a-42bde5cb1de8" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Lock "cinder-quobyte-1f1b484a-a996-4de1-956a-42bde5cb1de8" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c739d2c-5213-4546-b43c-45a5bd1e9542]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:01 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0" returned: 0 in 0.895s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.440s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1789327323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3efeed1-4cff-4d8a-ab52-019ac7632fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668f0f88df9c4e80bc85a87c042be8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:15:40Z,use_quota=True,user_id='a594eae5066449e884746a6ff4707599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Creating volume b3efeed1-4cff-4d8a-ab52-019ac7632fbd {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:01 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:16:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:02 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd 1073741824 Jul 06 12:16:02 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0913e0a-def9-43b3-b66b-53a636df1185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab72054-0b57-41ef-8da1-036c9640ba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:02 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8 Jul 06 12:16:02 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Volume volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0 (f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0): created successfully Jul 06 12:16:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab72054-0b57-41ef-8da1-036c9640ba19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (e1c1c683-453d-4a83-9cce-ceb4897833ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-06682cf3-7887-4518-a6b5-0fe26987eca5 tempest-VolumesActionsTest-1626448900 None] Created volume successfully. Jul 06 12:16:03 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8" returned: 0 in 1.082s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:03 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8 Jul 06 12:16:03 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:03 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd 1073741824" returned: 0 in 1.138s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:03 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd Jul 06 12:16:03 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "cinder-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "cinder-quobyte-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-quobyte-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4e6401-2679-4b25-a170-2a00c56c5ddc]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:03 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0 Jul 06 12:16:03 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:03 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1f1b484a-a996-4de1-956a-42bde5cb1de8" returned: 0 in 0.918s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Lock "cinder-quobyte-1f1b484a-a996-4de1-956a-42bde5cb1de8" released by "delete_volume" :: held 2.077s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Created reservations ['bacb5a36-c68d-4dd0-a1b0-d78a0a690a19'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:04 devstack cinder-volume[86561]: WARNING cinder.quota [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1402321890 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1402321890, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:16:04 devstack cinder-volume[86561]: WARNING cinder.quota [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1402321890 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1402321890, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Created reservations ['7bb0fd66-2a33-407d-b5a2-246529208fa1', 'bb666fa9-edfd-4468-9575-4dd2449cc5ca', '760d639a-8f85-4f8d-b7f8-a739be1b8cb6', '49246c92-fd34-423a-98f6-2ec93064923b'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:04 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" returned: 0 in 1.045s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.285s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Attempting download of b5606d26-431d-46eb-8401-a0b1e0a3d067 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}])) to volume b3efeed1-4cff-4d8a-ab52-019ac7632fbd. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:04 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:16:04 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25dda5b-8e19-43be-a386-0d5df9a3b166]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_54mu09if {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:04 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_54mu09if Jul 06 12:16:04 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:04 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0" returned: 0 in 1.193s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:04 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0 Jul 06 12:16:04 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:05 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_54mu09if" returned: 0 in 1.051s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_54mu09if {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:05 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.143s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:05 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4c95f57e-5306-4cfd-84fb-a65eee3c524f tempest-GroupsV314Test-954606303 None] Delete group completed successfully. Jul 06 12:16:05 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_54mu09if Jul 06 12:16:05 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Acquiring lock "cinder-quobyte-3f69af48-1f5d-4137-b10a-ea0c77100af7" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:05 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Lock "cinder-quobyte-3f69af48-1f5d-4137-b10a-ea0c77100af7" acquired by "delete_volume" :: waited 0.060s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0" returned: 0 in 1.145s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34b6a62-ab79-4ff3-b2e2-7724949c71b6]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-quobyte-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0" released by "delete_volume" :: held 2.437s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Created reservations ['d63194d4-a8e1-472b-a7db-2648c39b75fa', '437a995a-a212-4f08-b6bc-6a4a6f424b74', '08658dde-accc-421b-a981-c42fb6df8712', 'c99241f4-99b5-40d1-82c9-0eec9648974b'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:06 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 Jul 06 12:16:06 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:06 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:16:06 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:06 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_54mu09if" returned: 1 in 1.203s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_54mu09if' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0454714d-3bac-4660-8f65-10dcb42f6346]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:06 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD Jul 06 12:16:06 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:07 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7" returned: 0 in 1.075s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:07 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7 Jul 06 12:16:07 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:07 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.112s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Deleted volume successfully. Jul 06 12:16:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e40e08cf-1b35-4369-8c10-0690e7205b26 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-f76d5e45-8aeb-4bfc-a3d8-3c8a82161ca0-delete_volume" released by "delete_volume" :: held 3.935s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:08 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD" returned: 0 in 1.293s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] b5606d26-431d-46eb-8401-a0b1e0a3d067 was qcow2, converting to raw {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:08 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd Jul 06 12:16:08 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (5ac5dfd9-79eb-4008-8ab7-2f5469fcaa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a738218-5441-4f11-b7f0-53eb3c54f46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a738218-5441-4f11-b7f0-53eb3c54f46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-979648076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301b8268-66e8-4423-8718-099f640085fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:08Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebfa736-1979-4b2d-ba75-851d8d9d2710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebfa736-1979-4b2d-ba75-851d8d9d2710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7675d438-73f5-4e00-ae22-39f0bd5b04b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7675d438-73f5-4e00-ae22-39f0bd5b04b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301b8268-66e8-4423-8718-099f640085fa', 'volume_name': 'volume-301b8268-66e8-4423-8718-099f640085fa', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3fbe19-64c7-40af-ad3e-73b11cbdb2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3fbe19-64c7-40af-ad3e-73b11cbdb2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134466ac-5833-41ef-9ade-5a35f0262a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Volume 301b8268-66e8-4423-8718-099f640085fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301b8268-66e8-4423-8718-099f640085fa', 'volume_size': 1} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-979648076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301b8268-66e8-4423-8718-099f640085fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:08Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Creating volume 301b8268-66e8-4423-8718-099f640085fa {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:08 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:08 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f69af48-1f5d-4137-b10a-ea0c77100af7" returned: 0 in 1.500s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:08 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa 1073741824 Jul 06 12:16:08 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Lock "cinder-quobyte-3f69af48-1f5d-4137-b10a-ea0c77100af7" released by "delete_volume" :: held 2.707s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Created reservations ['41079e10-37b5-4ceb-b979-d8b3c89a9e90'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Created reservations ['d5a1b354-31fc-45a3-a7be-94aaa16d3738', '93e2fa1d-e7ec-48f7-9c01-924263040602', '8faff1ba-1327-415b-8c48-5b73f9547e39', 'f8d8150c-6aa5-46a9-8a73-a71597027314'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:09 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:16:09 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:10 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.165s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:10 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:10 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa 1073741824" returned: 0 in 1.685s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8994a1de-51e5-4699-bad7-c5efacc93f26 tempest-GroupsV314Test-954606303 None] Delete group completed successfully. Jul 06 12:16:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:10 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa Jul 06 12:16:10 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:11 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa" returned: 0 in 1.066s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] <== create_volume: return (2850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.858s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:11 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134466ac-5833-41ef-9ade-5a35f0262a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301b8268-66e8-4423-8718-099f640085fa', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2ec675-4514-4ede-8e9c-d2c7a3bad24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" returned: 0 in 3.449s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:11 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067__nmolxurdevstack@QuobyteHD, size 112.00 MB, duration 3.45 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:16:11 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Converted 112.00 MB image at 32.44 MB/s Jul 06 12:16:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:11 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Volume volume-301b8268-66e8-4423-8718-099f640085fa (301b8268-66e8-4423-8718-099f640085fa): created successfully Jul 06 12:16:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2ec675-4514-4ede-8e9c-d2c7a3bad24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:11 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd 1G Jul 06 12:16:11 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (5ac5dfd9-79eb-4008-8ab7-2f5469fcaa8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4c9c12e9-54c6-4f30-9e0f-6936f54108e4 tempest-VolumesActionsTest-1626448900 None] Created volume successfully. Jul 06 12:16:12 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd 1G" returned: 0 in 1.047s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e63d24-0fe6-4085-8ba8-1f777d2bb124]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:12 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd Jul 06 12:16:12 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "cinder-301b8268-66e8-4423-8718-099f640085fa-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-301b8268-66e8-4423-8718-099f640085fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "cinder-quobyte-301b8268-66e8-4423-8718-099f640085fa" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-quobyte-301b8268-66e8-4423-8718-099f640085fa" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18a9019-7658-4530-9a4f-a7bd92d004ac]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:13 devstack sudo[93450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa Jul 06 12:16:13 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:13 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" returned: 0 in 1.245s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:14 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd Jul 06 12:16:14 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:14 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa" returned: 0 in 1.038s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:14 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa Jul 06 12:16:14 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:14 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" returned: 1 in 1.088s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Downloaded image b5606d26-431d-46eb-8401-a0b1e0a3d067 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}])) to volume b3efeed1-4cff-4d8a-ab52-019ac7632fbd successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Temporary image b5606d26-431d-46eb-8401-a0b1e0a3d067 for user a594eae5066449e884746a6ff4707599 is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Marking volume b3efeed1-4cff-4d8a-ab52-019ac7632fbd as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Copying metadata from image b5606d26-431d-46eb-8401-a0b1e0a3d067 to b3efeed1-4cff-4d8a-ab52-019ac7632fbd. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:16:14 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Creating volume glance metadata for volume b3efeed1-4cff-4d8a-ab52-019ac7632fbd backed by image b5606d26-431d-46eb-8401-a0b1e0a3d067 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47204e85-ce61-4713-8771-f45259a776f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9783510-da81-4a39-81f9-fa3682e3cf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Volume volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd (b3efeed1-4cff-4d8a-ab52-019ac7632fbd): created successfully Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9783510-da81-4a39-81f9-fa3682e3cf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Flow 'volume_create_manager' (2072cf00-d7c3-40a6-af9d-df61935bc93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:15 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-301b8268-66e8-4423-8718-099f640085fa" returned: 0 in 0.841s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-66b94290-ad7b-43c7-8bf2-53c5db82bd37 tempest-VolumesExtendTest-1305641598 None] Created volume successfully. Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-quobyte-301b8268-66e8-4423-8718-099f640085fa" released by "delete_volume" :: held 1.935s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Created reservations ['e11a919f-e04b-4e2e-939b-842909033da2', 'ec4ea679-3fe9-4fb6-a5bf-d7f07d9cf6a4', 'bdba3864-3dde-4e30-8e16-fdd678188069', 'db8d8a55-5f2c-4975-a4fc-5a1609b12829'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:15 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:16:15 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (0c0ef24c-2553-47b4-9297-9d3be94b9c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16d1c99-7d26-4902-a67d-a6c7d910d42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b16d1c99-7d26-4902-a67d-a6c7d910d42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2101004796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8416378f-675e-436b-8039-d3005e7bc130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:16Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e074788b-31a3-4052-95c2-2beabb454bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e074788b-31a3-4052-95c2-2beabb454bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf36ef18-56d7-4544-8361-0bd3809112ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf36ef18-56d7-4544-8361-0bd3809112ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8416378f-675e-436b-8039-d3005e7bc130', 'volume_name': 'volume-8416378f-675e-436b-8039-d3005e7bc130', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:16 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcae6af-de70-4a4a-b2cb-64dc9e264253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcae6af-de70-4a4a-b2cb-64dc9e264253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc7f347-9941-4786-a7a4-7a0449ce9ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:16 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Volume 8416378f-675e-436b-8039-d3005e7bc130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8416378f-675e-436b-8039-d3005e7bc130', 'volume_size': 1} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2101004796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8416378f-675e-436b-8039-d3005e7bc130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87834d9e6c8747e4aae97d33019be3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:16Z,use_quota=True,user_id='78d6127032ba44ac8b90ca925037b9ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Creating volume 8416378f-675e-436b-8039-d3005e7bc130 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:16 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.981s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Deleted volume successfully. Jul 06 12:16:16 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130 1073741824 Jul 06 12:16:16 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-249b9f50-ef80-4e59-8efc-2ce3b3c0e147 tempest-VolumesActionsTest-1627363050 None] Lock "cinder-301b8268-66e8-4423-8718-099f640085fa-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb6c6902-70c7-4ba9-b61b-bb351b56bf60 tempest-VolumesExtendTest-1305641598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:17 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130 1073741824" returned: 0 in 1.178s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:17 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130 Jul 06 12:16:17 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:18 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130" returned: 0 in 0.810s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb6c6902-70c7-4ba9-b61b-bb351b56bf60 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.764s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc7f347-9941-4786-a7a4-7a0449ce9ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8416378f-675e-436b-8039-d3005e7bc130', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06608775-cf80-4d23-8d3e-fbb2f6585319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Volume volume-8416378f-675e-436b-8039-d3005e7bc130 (8416378f-675e-436b-8039-d3005e7bc130): created successfully Jul 06 12:16:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06608775-cf80-4d23-8d3e-fbb2f6585319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Flow 'volume_create_manager' (0c0ef24c-2553-47b4-9297-9d3be94b9c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7218d519-95e5-4d76-9faf-b30944894d5c]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb6c6902-70c7-4ba9-b61b-bb351b56bf60 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-892e6587-afd8-47d8-b061-835f4ec2575a tempest-VolumesActionsTest-1626448900 None] Created volume successfully. Jul 06 12:16:18 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd Jul 06 12:16:18 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:19 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb6c6902-70c7-4ba9-b61b-bb351b56bf60 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" returned: 0 in 1.004s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb6c6902-70c7-4ba9-b61b-bb351b56bf60 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:19 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd Jul 06 12:16:19 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "cinder-8416378f-675e-436b-8039-d3005e7bc130-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Lock "cinder-8416378f-675e-436b-8039-d3005e7bc130-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "cinder-quobyte-8416378f-675e-436b-8039-d3005e7bc130" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Lock "cinder-quobyte-8416378f-675e-436b-8039-d3005e7bc130" acquired by "delete_volume" :: waited 0.037s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:20 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb6c6902-70c7-4ba9-b61b-bb351b56bf60 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" returned: 1 in 1.204s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb6c6902-70c7-4ba9-b61b-bb351b56bf60 tempest-VolumesExtendTest-1305641598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb6c6902-70c7-4ba9-b61b-bb351b56bf60 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd 2G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81d9cab-4233-4613-a87f-4cecf3a0c8de]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb6c6902-70c7-4ba9-b61b-bb351b56bf60 tempest-VolumesExtendTest-1305641598 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd 2G" returned: 0 in 0.101s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb6c6902-70c7-4ba9-b61b-bb351b56bf60 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.378s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:20 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fb6c6902-70c7-4ba9-b61b-bb351b56bf60 tempest-VolumesExtendTest-1305641598 None] Extend volume completed successfully. Jul 06 12:16:20 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130 Jul 06 12:16:20 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Acquiring lock "cinder-b3efeed1-4cff-4d8a-ab52-019ac7632fbd-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Lock "cinder-b3efeed1-4cff-4d8a-ab52-019ac7632fbd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Acquiring lock "cinder-quobyte-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Lock "cinder-quobyte-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:21 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccddb72a-167f-4a1a-ac48-b8eb17428067]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:21 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd Jul 06 12:16:21 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130" returned: 0 in 1.200s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:21 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:21 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130 Jul 06 12:16:21 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:22 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" returned: 0 in 1.226s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:22 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:22 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd Jul 06 12:16:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8416378f-675e-436b-8039-d3005e7bc130" returned: 0 in 0.949s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:22 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Lock "cinder-quobyte-8416378f-675e-436b-8039-d3005e7bc130" released by "delete_volume" :: held 2.234s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:22 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Created reservations ['2e3c2fae-cccc-4c7e-9332-33e6f5c7a55b', 'eac0af41-3cf4-49e5-b673-e944f1fe22e5', 'e3938bdd-9cf8-4a37-ad02-3f8bb8b8ec1e', '76487ddd-6140-4170-9a90-a954b4b0bb18'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:23 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:16:23 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-02819610-1908-4ac5-b6f0-1fdedc22d7d2 req-e2fccc40-2334-4400-a33a-53b6ea8a1333 tempest-AttachVolumeTestJSON-600723819 None] Terminate volume connection completed successfully. Jul 06 12:16:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-02819610-1908-4ac5-b6f0-1fdedc22d7d2 req-e2fccc40-2334-4400-a33a-53b6ea8a1333 tempest-AttachVolumeTestJSON-600723819 None] Deleting attachment 960d8e50-391c-43ba-babf-1801fe398a3b. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:16:23 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" returned: 1 in 0.983s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:16:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:23 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd Jul 06 12:16:23 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:23 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.974s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:23 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Deleted volume successfully. Jul 06 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dfa0f2fb-6f58-4403-b09c-e32e857f6d95 tempest-VolumesActionsTest-1626448900 None] Lock "cinder-8416378f-675e-436b-8039-d3005e7bc130-delete_volume" released by "delete_volume" :: held 3.555s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:24 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" returned: 0 in 1.119s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Lock "cinder-quobyte-b3efeed1-4cff-4d8a-ab52-019ac7632fbd" released by "delete_volume" :: held 3.425s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Created reservations ['95e70009-3b86-4d3c-8665-6f8d96328739', 'ae328236-b8a9-4175-83ef-725f938a686a', '6963a6ee-1711-492a-96e4-378f7e04c6ac', '0ab89287-4b2e-4592-aa85-6a193eef1078'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:25 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:16:25 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:25 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.895s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Deleted volume successfully. Jul 06 12:16:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb29f0e9-628c-4879-a759-b19d6e6adf9d tempest-VolumesExtendTest-1305641598 None] Lock "cinder-b3efeed1-4cff-4d8a-ab52-019ac7632fbd-delete_volume" released by "delete_volume" :: held 4.665s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Flow 'volume_create_manager' (23a13eae-ee49-48fb-9a81-b79082a19c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0934e047-fdbc-41b4-9e72-563654f16993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0934e047-fdbc-41b4-9e72-563654f16993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1625250348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37450e4a-3913-4741-a40e-51b6d66e0a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668f0f88df9c4e80bc85a87c042be8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:27Z,use_quota=True,user_id='a594eae5066449e884746a6ff4707599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b75f773-5ada-4036-8732-47bb0c27dd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b75f773-5ada-4036-8732-47bb0c27dd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9554c294-daf8-4513-862f-08a2fa30701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9554c294-daf8-4513-862f-08a2fa30701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37450e4a-3913-4741-a40e-51b6d66e0a01', 'volume_name': 'volume-37450e4a-3913-4741-a40e-51b6d66e0a01', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53db073f-bf09-4dc9-91d4-665b9af97d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53db073f-bf09-4dc9-91d4-665b9af97d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351a9575-2b4d-48d4-aa39-13aea59043eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Volume 37450e4a-3913-4741-a40e-51b6d66e0a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37450e4a-3913-4741-a40e-51b6d66e0a01', 'volume_size': 1} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1625250348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37450e4a-3913-4741-a40e-51b6d66e0a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668f0f88df9c4e80bc85a87c042be8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:27Z,use_quota=True,user_id='a594eae5066449e884746a6ff4707599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Creating volume 37450e4a-3913-4741-a40e-51b6d66e0a01 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:26 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:26 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 1073741824 Jul 06 12:16:26 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Flow 'volume_create_manager' (ae08b80e-9840-42df-a2a7-15112ae84579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c7de99-8080-4a5f-a80b-9f1ec62641ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c7de99-8080-4a5f-a80b-9f1ec62641ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-18810165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0061e375-9d3b-498c-a8b0-6391ea5fe7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f14662c8744ef6b3d508bac244e5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:27Z,use_quota=True,user_id='ee665d154568422f8b0f572579ff140f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8010c798-70b1-4a87-933b-7b8ffeaffe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8010c798-70b1-4a87-933b-7b8ffeaffe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112b2270-07a6-4ae9-b333-c3b08031642a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112b2270-07a6-4ae9-b333-c3b08031642a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0061e375-9d3b-498c-a8b0-6391ea5fe7b0', 'volume_name': 'volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9019c1-62ec-4e2b-94c3-f9bcb927be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9019c1-62ec-4e2b-94c3-f9bcb927be0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631c60ca-7a58-4bec-8c11-d431c9210b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Volume 0061e375-9d3b-498c-a8b0-6391ea5fe7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0', 'volume_size': 1} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:27 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 1073741824" returned: 0 in 1.119s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:27 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 Jul 06 12:16:27 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:28 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01" returned: 0 in 1.017s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.893s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-18810165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0061e375-9d3b-498c-a8b0-6391ea5fe7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f14662c8744ef6b3d508bac244e5c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:27Z,use_quota=True,user_id='ee665d154568422f8b0f572579ff140f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Creating volume 0061e375-9d3b-498c-a8b0-6391ea5fe7b0 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:28 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:16:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351a9575-2b4d-48d4-aa39-13aea59043eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37450e4a-3913-4741-a40e-51b6d66e0a01', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:29 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0 1073741824 Jul 06 12:16:29 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd3b9cb-bbdd-4fc8-8267-ee0d4f721f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Volume volume-37450e4a-3913-4741-a40e-51b6d66e0a01 (37450e4a-3913-4741-a40e-51b6d66e0a01): created successfully Jul 06 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd3b9cb-bbdd-4fc8-8267-ee0d4f721f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Flow 'volume_create_manager' (23a13eae-ee49-48fb-9a81-b79082a19c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f0ccad0b-679e-4d25-82f7-d0074d856a4e tempest-VolumesExtendTest-1305641598 None] Created volume successfully. Jul 06 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:30 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0 1073741824" returned: 0 in 1.209s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:30 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0 Jul 06 12:16:30 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:31 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0" returned: 0 in 0.936s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.213s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.093s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] Creating offline snapshot bcffab9c-1985-48ad-b120-7923e2d37ff9 of volume 37450e4a-3913-4741-a40e-51b6d66e0a01 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:16:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631c60ca-7a58-4bec-8c11-d431c9210b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6446d5b-fae6-497b-a044-456fb0a6df75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d5a51f-5b5d-48d3-8e8f-60d1fd9ad04d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Volume volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0 (0061e375-9d3b-498c-a8b0-6391ea5fe7b0): created successfully Jul 06 12:16:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6446d5b-fae6-497b-a044-456fb0a6df75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Flow 'volume_create_manager' (ae08b80e-9840-42df-a2a7-15112ae84579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-630e85fa-3346-44fa-9f8b-da42698adeb2 tempest-VolumesServicesTestJSON-1139255535 None] Created volume successfully. Jul 06 12:16:31 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 Jul 06 12:16:31 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:32 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01" returned: 0 in 1.026s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:32 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 1G Jul 06 12:16:32 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Acquiring lock "cinder-0061e375-9d3b-498c-a8b0-6391ea5fe7b0-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Lock "cinder-0061e375-9d3b-498c-a8b0-6391ea5fe7b0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Acquiring lock "cinder-quobyte-0061e375-9d3b-498c-a8b0-6391ea5fe7b0" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Lock "cinder-quobyte-0061e375-9d3b-498c-a8b0-6391ea5fe7b0" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38a92c4-50dd-4ebe-8380-8fd7a134a8ee]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:32 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:16:32 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:33 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0 Jul 06 12:16:33 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:33 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 1G" returned: 0 in 1.546s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37450e4a-3913-4741-a40e-51b6d66e0a01 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:33 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37450e4a-3913-4741-a40e-51b6d66e0a01 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 Jul 06 12:16:33 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:34 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0" returned: 0 in 1.294s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:34 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.340s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:34 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:16:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 28 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:16:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:16:34 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0 Jul 06 12:16:34 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:34 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37450e4a-3913-4741-a40e-51b6d66e0a01 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9" returned: 0 in 0.925s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:34 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 is being set with open permissions: ugo+rw Jul 06 12:16:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:34 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 Jul 06 12:16:34 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:35 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0061e375-9d3b-498c-a8b0-6391ea5fe7b0" returned: 0 in 0.998s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Lock "cinder-quobyte-0061e375-9d3b-498c-a8b0-6391ea5fe7b0" released by "delete_volume" :: held 2.421s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:35 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Created reservations ['f278e6fa-fac7-46f3-a329-90e66a755615', '3308e1c2-2394-457c-ad9c-26feff40829c', 'a4e5677d-408a-463f-aba8-87fafbf148cb', '95201146-f1b9-4648-a73c-7548639182ae'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:35 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:16:35 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:35 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9" returned: 0 in 1.262s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:36 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.info Jul 06 12:16:36 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:36 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.340s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:36 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Deleted volume successfully. Jul 06 12:16:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f10e71b6-bcf2-4ddf-af84-aabc1fe50e34 tempest-VolumesServicesTestJSON-1139255535 None] Lock "cinder-0061e375-9d3b-498c-a8b0-6391ea5fe7b0-delete_volume" released by "delete_volume" :: held 4.227s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:37 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.info" returned: 0 in 1.629s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:37 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.info is being set with open permissions: ugo+rw Jul 06 12:16:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:37 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.info Jul 06 12:16:37 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:39 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.info" returned: 0 in 1.475s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.027s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2e094006-a7f5-40a3-ac1c-43fba43df497 tempest-VolumesExtendTest-1305641598 None] Create snapshot completed successfully Jul 06 12:16:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cf752015-67f6-4a54-aa15-68b3490c1595 tempest-VolumesExtendTest-1305641598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cf752015-67f6-4a54-aa15-68b3490c1595 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a6ae98-1666-4e00-a7d9-3e80313b49c8]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cf752015-67f6-4a54-aa15-68b3490c1595 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:40 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 Jul 06 12:16:40 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:41 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cf752015-67f6-4a54-aa15-68b3490c1595 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01" returned: 0 in 1.680s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cf752015-67f6-4a54-aa15-68b3490c1595 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 2G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cf752015-67f6-4a54-aa15-68b3490c1595 tempest-VolumesExtendTest-1305641598 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 2G" returned: 0 in 0.256s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cf752015-67f6-4a54-aa15-68b3490c1595 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.020s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cf752015-67f6-4a54-aa15-68b3490c1595 tempest-VolumesExtendTest-1305641598 None] Extend volume completed successfully. Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Acquiring lock "cinder-bcffab9c-1985-48ad-b120-7923e2d37ff9-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Lock "cinder-bcffab9c-1985-48ad-b120-7923e2d37ff9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Acquiring lock "cinder-quobyte-37450e4a-3913-4741-a40e-51b6d66e0a01" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Lock "cinder-quobyte-37450e4a-3913-4741-a40e-51b6d66e0a01" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Acquiring lock "cinder-quobyte-bcffab9c-1985-48ad-b120-7923e2d37ff9" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Lock "cinder-quobyte-bcffab9c-1985-48ad-b120-7923e2d37ff9" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Deleting offline snapshot bcffab9c-1985-48ad-b120-7923e2d37ff9 of volume 37450e4a-3913-4741-a40e-51b6d66e0a01 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] snapshot_file for this snap is: volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12bdf63-89ce-4438-b876-d27144aa629a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:42 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 Jul 06 12:16:42 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:43 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9" returned: 0 in 1.303s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37450e4a-3913-4741-a40e-51b6d66e0a01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:16:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0d9efb-305e-4060-a7a9-75b7bd17b81b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:44 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 Jul 06 12:16:44 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:45 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01" returned: 0 in 1.310s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:45 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 Jul 06 12:16:45 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Flow 'volume_create_manager' (80d9aa49-abf9-4af9-a1dc-05385b46a97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e703fe09-d369-4b71-919f-201f21d557ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e703fe09-d369-4b71-919f-201f21d557ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2114766907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5a7385-b926-4c30-bac7-19ac6b237858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422b641c46b54d4e941e74b0e32c3853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:45Z,use_quota=True,user_id='cdb220d1912f401aaf20dfebc2295296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e10513-b3f7-47d7-9c03-0c2d4bb0bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e10513-b3f7-47d7-9c03-0c2d4bb0bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9256e24d-db81-4bfe-b3c5-3d48c200dbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9256e24d-db81-4bfe-b3c5-3d48c200dbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a5a7385-b926-4c30-bac7-19ac6b237858', 'volume_name': 'volume-4a5a7385-b926-4c30-bac7-19ac6b237858', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098b4688-8333-4bbe-9bf0-bac8d43485e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098b4688-8333-4bbe-9bf0-bac8d43485e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79145113-7bbf-43ea-903f-8ef79408651b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:45 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Volume 4a5a7385-b926-4c30-bac7-19ac6b237858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a5a7385-b926-4c30-bac7-19ac6b237858', 'volume_size': 1} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2114766907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5a7385-b926-4c30-bac7-19ac6b237858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422b641c46b54d4e941e74b0e32c3853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:45Z,use_quota=True,user_id='cdb220d1912f401aaf20dfebc2295296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Creating volume 4a5a7385-b926-4c30-bac7-19ac6b237858 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:45 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:16:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:45 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858 1073741824 Jul 06 12:16:45 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:46 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9" returned: 0 in 1.240s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:46 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9 Jul 06 12:16:46 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:46 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858 1073741824" returned: 0 in 1.293s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:46 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858 Jul 06 12:16:46 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:47 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01.bcffab9c-1985-48ad-b120-7923e2d37ff9" returned: 0 in 0.888s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Lock "cinder-quobyte-bcffab9c-1985-48ad-b120-7923e2d37ff9" released by "_delete_snapshot" :: held 4.929s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Lock "cinder-quobyte-37450e4a-3913-4741-a40e-51b6d66e0a01" released by "delete_snapshot" :: held 4.975s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:47 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Created reservations ['84ebb081-94a3-4ad2-8dae-6269b3f4a56c', '938bdee8-139c-4e56-9bce-4271f62a2d48', '5427bd01-4c32-40f0-9207-a0be7925d7ca', '5a70efa8-a3ec-4921-9d85-63653f646f31'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Delete snapshot completed successfully. Jul 06 12:16:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-be07ff1a-7e45-4fa5-8833-095f5fcf66da tempest-VolumesExtendTest-1305641598 None] Lock "cinder-bcffab9c-1985-48ad-b120-7923e2d37ff9-delete_snapshot" released by "delete_snapshot" :: held 5.375s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:48 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858" returned: 0 in 1.314s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] <== create_volume: return (2681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.685s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79145113-7bbf-43ea-903f-8ef79408651b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a5a7385-b926-4c30-bac7-19ac6b237858', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e88ee3d-5370-4c91-b247-ae7b46d83dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Acquiring lock "cinder-37450e4a-3913-4741-a40e-51b6d66e0a01-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:48 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Volume volume-4a5a7385-b926-4c30-bac7-19ac6b237858 (4a5a7385-b926-4c30-bac7-19ac6b237858): created successfully Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e88ee3d-5370-4c91-b247-ae7b46d83dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Flow 'volume_create_manager' (80d9aa49-abf9-4af9-a1dc-05385b46a97f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Lock "cinder-37450e4a-3913-4741-a40e-51b6d66e0a01-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:48 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3cde49c9-241f-40e7-bf62-5853ee64f479 tempest-VolumesListAdminTestJSON-1997827684 None] Created volume successfully. Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Acquiring lock "cinder-quobyte-37450e4a-3913-4741-a40e-51b6d66e0a01" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Lock "cinder-quobyte-37450e4a-3913-4741-a40e-51b6d66e0a01" acquired by "delete_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf2f666-f68c-4ced-b78a-2e9806ecd958]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:16:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:48 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 Jul 06 12:16:48 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:49 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01" returned: 0 in 1.261s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:49 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01 Jul 06 12:16:49 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Flow 'volume_create_manager' (c385451e-3322-4b21-8bcb-7027c3d336fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12d5eb8-d0f1-4c53-9736-a25422a90630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12d5eb8-d0f1-4c53-9736-a25422a90630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2012598389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405bf544-4a6d-4544-98a1-e134f4639f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422b641c46b54d4e941e74b0e32c3853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:50Z,use_quota=True,user_id='cdb220d1912f401aaf20dfebc2295296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473044fd-d48e-467f-90eb-17e4fb684693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473044fd-d48e-467f-90eb-17e4fb684693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a32196-884a-4642-bc6e-992f4ec5a2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a32196-884a-4642-bc6e-992f4ec5a2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '405bf544-4a6d-4544-98a1-e134f4639f7f', 'volume_name': 'volume-405bf544-4a6d-4544-98a1-e134f4639f7f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276e08ab-52e1-4ace-9f8e-999e7fabd76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276e08ab-52e1-4ace-9f8e-999e7fabd76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac018b8f-425b-4f54-99da-530fad22f229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:49 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Volume 405bf544-4a6d-4544-98a1-e134f4639f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-405bf544-4a6d-4544-98a1-e134f4639f7f', 'volume_size': 1} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2012598389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405bf544-4a6d-4544-98a1-e134f4639f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422b641c46b54d4e941e74b0e32c3853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:50Z,use_quota=True,user_id='cdb220d1912f401aaf20dfebc2295296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Creating volume 405bf544-4a6d-4544-98a1-e134f4639f7f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:49 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:16:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:49 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f 1073741824 Jul 06 12:16:49 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:50 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-37450e4a-3913-4741-a40e-51b6d66e0a01" returned: 0 in 1.091s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Lock "cinder-quobyte-37450e4a-3913-4741-a40e-51b6d66e0a01" released by "delete_volume" :: held 2.466s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:50 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Created reservations ['72f7fe1e-6857-49f6-8824-05174244fcbd', 'b2ae39e3-8741-4ca5-b30e-1f61bfe6df58', 'debf6391-5a78-42cf-b9e9-883c1e7dff96', 'af1cd206-7036-424a-bc6c-777e671098dd'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:16:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:51 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:16:51 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:51 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f 1073741824" returned: 0 in 1.279s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:51 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f Jul 06 12:16:51 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:52 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.180s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:16:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Deleted volume successfully. Jul 06 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-93b31e7c-1a97-463a-9595-9265688ef581 tempest-VolumesExtendTest-1305641598 None] Lock "cinder-37450e4a-3913-4741-a40e-51b6d66e0a01-delete_volume" released by "delete_volume" :: held 4.009s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:16:52 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f" returned: 0 in 1.191s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] <== create_volume: return (2540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.544s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac018b8f-425b-4f54-99da-530fad22f229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405bf544-4a6d-4544-98a1-e134f4639f7f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79de981f-4d40-420e-8a97-65787aaeceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Volume volume-405bf544-4a6d-4544-98a1-e134f4639f7f (405bf544-4a6d-4544-98a1-e134f4639f7f): created successfully Jul 06 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79de981f-4d40-420e-8a97-65787aaeceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Flow 'volume_create_manager' (c385451e-3322-4b21-8bcb-7027c3d336fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-641b3353-aa5b-45f0-9916-15c0c33824e1 tempest-VolumesListAdminTestJSON-1997827684 None] Created volume successfully. Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Flow 'volume_create_manager' (52759149-320e-4b64-b21f-155354276a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571d5897-0864-4684-9a39-c0e22d2ead78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571d5897-0864-4684-9a39-c0e22d2ead78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-557207648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35838be4-d8a7-4a8f-b2e2-6b9824ac6077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422b641c46b54d4e941e74b0e32c3853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:54Z,use_quota=True,user_id='cdb220d1912f401aaf20dfebc2295296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74c2326-0c13-4477-a487-33f705c959c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74c2326-0c13-4477-a487-33f705c959c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b17d593-236c-4a4e-8f19-3f3b756fb2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b17d593-236c-4a4e-8f19-3f3b756fb2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35838be4-d8a7-4a8f-b2e2-6b9824ac6077', 'volume_name': 'volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c821c938-d883-4be4-9c1d-513ff7aab0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c821c938-d883-4be4-9c1d-513ff7aab0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef9d86d-a540-4841-94e5-ec8b76f80470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Volume 35838be4-d8a7-4a8f-b2e2-6b9824ac6077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077', 'volume_size': 1} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-557207648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35838be4-d8a7-4a8f-b2e2-6b9824ac6077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422b641c46b54d4e941e74b0e32c3853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:54Z,use_quota=True,user_id='cdb220d1912f401aaf20dfebc2295296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Creating volume 35838be4-d8a7-4a8f-b2e2-6b9824ac6077 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:53 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:16:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:53 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077 1073741824 Jul 06 12:16:53 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Flow 'volume_create_manager' (b8a2590e-63ee-4cf6-9460-63dbd1202127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7117f1e-700d-4bb9-b835-ee936facd2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7117f1e-700d-4bb9-b835-ee936facd2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1326751296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24e5fcd-0a23-470d-83d3-2d7986593a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ed417bdcb04a9abfadf103d83cc131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:54Z,use_quota=True,user_id='d2c9d71a52d048b8a6da2f354cabb693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20a6669-93f3-4222-b09e-364988b837fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20a6669-93f3-4222-b09e-364988b837fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75498f48-8937-4100-960b-17f31625ca17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75498f48-8937-4100-960b-17f31625ca17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24e5fcd-0a23-470d-83d3-2d7986593a03', 'volume_name': 'volume-b24e5fcd-0a23-470d-83d3-2d7986593a03', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a955b8-8305-4852-ba3c-0db2ac61a7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a955b8-8305-4852-ba3c-0db2ac61a7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e685377-963b-43fd-8e42-43d261e4a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:54 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Volume b24e5fcd-0a23-470d-83d3-2d7986593a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24e5fcd-0a23-470d-83d3-2d7986593a03', 'volume_size': 1} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:54 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077 1073741824" returned: 0 in 1.057s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=109,cinder:SELECT=95,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=112,cinder:SELECT=73,cinder:INSERT=30,cinder:DELETE=8 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:16:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:54 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077 Jul 06 12:16:54 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:55 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077" returned: 0 in 0.806s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.442s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1326751296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24e5fcd-0a23-470d-83d3-2d7986593a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ed417bdcb04a9abfadf103d83cc131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:54Z,use_quota=True,user_id='d2c9d71a52d048b8a6da2f354cabb693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Creating volume b24e5fcd-0a23-470d-83d3-2d7986593a03 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:55 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef9d86d-a540-4841-94e5-ec8b76f80470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:55 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 1073741824 Jul 06 12:16:55 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72934370-0fa0-44e8-a6e9-7297ed74f0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Volume volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077 (35838be4-d8a7-4a8f-b2e2-6b9824ac6077): created successfully Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72934370-0fa0-44e8-a6e9-7297ed74f0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Flow 'volume_create_manager' (52759149-320e-4b64-b21f-155354276a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9d7d2437-a893-42a5-90b2-c28d958ffb14 tempest-VolumesListAdminTestJSON-1997827684 None] Created volume successfully. Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Flow 'volume_create_manager' (d0c80ccf-c8bb-465e-8177-be272b63d7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50b68e7-8e02-4c77-ad25-1f82133d0b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50b68e7-8e02-4c77-ad25-1f82133d0b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-619109615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89ef140-d539-4900-88ae-0c98c7d998a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62351269906e4eb89cdd7f19dabf614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:56Z,use_quota=True,user_id='005fa582872a4f5b9a074e161f10553e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757ae6d9-3f3b-44c2-a8b8-7e24cc12bca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757ae6d9-3f3b-44c2-a8b8-7e24cc12bca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e68430a-e515-4c92-b1d4-e16993d0e778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e68430a-e515-4c92-b1d4-e16993d0e778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89ef140-d539-4900-88ae-0c98c7d998a4', 'volume_name': 'volume-e89ef140-d539-4900-88ae-0c98c7d998a4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b297d4c5-ad6e-40e9-b303-2f531056ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b297d4c5-ad6e-40e9-b303-2f531056ab92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70a6fe1-640b-41a2-9cc4-7b73d04df718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Volume e89ef140-d539-4900-88ae-0c98c7d998a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89ef140-d539-4900-88ae-0c98c7d998a4', 'volume_size': 1} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:56 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 1073741824" returned: 0 in 1.052s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:56 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 Jul 06 12:16:56 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:57 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03" returned: 0 in 0.743s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.336s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-619109615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89ef140-d539-4900-88ae-0c98c7d998a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62351269906e4eb89cdd7f19dabf614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:56Z,use_quota=True,user_id='005fa582872a4f5b9a074e161f10553e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Creating volume e89ef140-d539-4900-88ae-0c98c7d998a4 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:57 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:57 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4 1073741824 Jul 06 12:16:57 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e685377-963b-43fd-8e42-43d261e4a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24e5fcd-0a23-470d-83d3-2d7986593a03', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ccc44b5-5a39-4b21-99fd-fcae441f97fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Volume volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 (b24e5fcd-0a23-470d-83d3-2d7986593a03): created successfully Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ccc44b5-5a39-4b21-99fd-fcae441f97fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Flow 'volume_create_manager' (b8a2590e-63ee-4cf6-9460-63dbd1202127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-540bb6f3-3368-4165-93a5-2dd5a2db7b2b tempest-SnapshotMetadataTestJSON-1171017621 None] Created volume successfully. Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Flow 'volume_create_manager' (0b402a1b-4b3a-4a2e-9b03-b558652d3915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a597c6-fff6-43f1-8bbc-a6f8cd54aae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a597c6-fff6-43f1-8bbc-a6f8cd54aae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068cc443-658d-4f27-81b1-d2e327f42037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16cabdb22f57484dbdb9782269f45772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:58Z,use_quota=True,user_id='42ab6a6acf6744299e0842eab0a0eff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4b8b33-5ba7-4718-9939-14d881465bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4b8b33-5ba7-4718-9939-14d881465bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca741796-894c-40d9-a57b-573f98544077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca741796-894c-40d9-a57b-573f98544077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '068cc443-658d-4f27-81b1-d2e327f42037', 'volume_name': 'volume-068cc443-658d-4f27-81b1-d2e327f42037', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4330b34-a7e4-4d1d-984b-3842bc04c3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4330b34-a7e4-4d1d-984b-3842bc04c3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5487972e-d7b9-4b66-820f-6b7859cec736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Volume 068cc443-658d-4f27-81b1-d2e327f42037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-068cc443-658d-4f27-81b1-d2e327f42037', 'volume_size': 1} Jul 06 12:16:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:58 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4 1073741824" returned: 0 in 1.104s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:58 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4 Jul 06 12:16:58 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:59 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4" returned: 0 in 0.698s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.597s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068cc443-658d-4f27-81b1-d2e327f42037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16cabdb22f57484dbdb9782269f45772',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:16:58Z,use_quota=True,user_id='42ab6a6acf6744299e0842eab0a0eff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Creating volume 068cc443-658d-4f27-81b1-d2e327f42037 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:16:59 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70a6fe1-640b-41a2-9cc4-7b73d04df718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89ef140-d539-4900-88ae-0c98c7d998a4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:59 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037 1073741824 Jul 06 12:16:59 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6737bdd6-0d82-4ec1-911c-98865b4be2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:16:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Volume volume-e89ef140-d539-4900-88ae-0c98c7d998a4 (e89ef140-d539-4900-88ae-0c98c7d998a4): created successfully Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6737bdd6-0d82-4ec1-911c-98865b4be2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:16:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Flow 'volume_create_manager' (d0c80ccf-c8bb-465e-8177-be272b63d7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:16:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e28f7fef-491d-4c19-95a7-22f37403aea3 tempest-VolumesListTestJSON-1902203834 None] Created volume successfully. Jul 06 12:17:00 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037 1073741824" returned: 0 in 0.979s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:00 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037 Jul 06 12:17:00 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Flow 'volume_create_manager' (580ff11e-16fa-43a8-985a-0b350c4ebe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf95a23e-565e-4d27-8040-006ede72ffe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf95a23e-565e-4d27-8040-006ede72ffe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-554269954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe713a9-45b2-4e66-9b00-c39d64aaab71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62351269906e4eb89cdd7f19dabf614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:01Z,use_quota=True,user_id='005fa582872a4f5b9a074e161f10553e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb01c877-9144-48d6-9c3c-83094cbaeb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb01c877-9144-48d6-9c3c-83094cbaeb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666636ca-c166-4d46-bb68-36cbd2e34911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666636ca-c166-4d46-bb68-36cbd2e34911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe713a9-45b2-4e66-9b00-c39d64aaab71', 'volume_name': 'volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce196fbf-1ea2-4c30-9cd6-72139d95b9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce196fbf-1ea2-4c30-9cd6-72139d95b9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f5ae68-6e6d-4784-b9f6-69fecda7ac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Volume 6fe713a9-45b2-4e66-9b00-c39d64aaab71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71', 'volume_size': 1} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:01 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037" returned: 0 in 0.871s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.788s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] Creating offline snapshot ba5d92a2-56fd-487d-aa67-576aa0644973 of volume b24e5fcd-0a23-470d-83d3-2d7986593a03 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5487972e-d7b9-4b66-820f-6b7859cec736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-068cc443-658d-4f27-81b1-d2e327f42037', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadfff1d-a4aa-4966-8e99-fb14ae0c81e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9027ec74-5083-49e0-b789-e25893f67e20]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Volume volume-068cc443-658d-4f27-81b1-d2e327f42037 (068cc443-658d-4f27-81b1-d2e327f42037): created successfully Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadfff1d-a4aa-4966-8e99-fb14ae0c81e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Flow 'volume_create_manager' (0b402a1b-4b3a-4a2e-9b03-b558652d3915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-532f590d-f7d0-458e-a139-fb123584f890 tempest-VolumesListAdminTestJSON-771255695 None] Created volume successfully. Jul 06 12:17:01 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 Jul 06 12:17:01 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Acquiring lock "cinder-068cc443-658d-4f27-81b1-d2e327f42037-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Lock "cinder-068cc443-658d-4f27-81b1-d2e327f42037-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Acquiring lock "cinder-quobyte-068cc443-658d-4f27-81b1-d2e327f42037" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Lock "cinder-quobyte-068cc443-658d-4f27-81b1-d2e327f42037" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6699dd90-6992-4741-bbcd-20ee31bdd57c]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "cinder-35838be4-d8a7-4a8f-b2e2-6b9824ac6077-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-35838be4-d8a7-4a8f-b2e2-6b9824ac6077-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "cinder-quobyte-35838be4-d8a7-4a8f-b2e2-6b9824ac6077" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:02 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037 Jul 06 12:17:02 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:02 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-quobyte-35838be4-d8a7-4a8f-b2e2-6b9824ac6077" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03" returned: 0 in 1.105s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9daa18-22f2-4b06-a053-ce3ab4265dfb]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:02 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 1G Jul 06 12:17:02 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:02 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077 Jul 06 12:17:02 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:03 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037" returned: 0 in 1.135s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:03 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037 Jul 06 12:17:03 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:03 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 1G" returned: 0 in 1.193s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:03 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 Jul 06 12:17:03 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:03 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077" returned: 0 in 1.226s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:03 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077 Jul 06 12:17:03 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:04 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-068cc443-658d-4f27-81b1-d2e327f42037" returned: 0 in 1.316s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Lock "cinder-quobyte-068cc443-658d-4f27-81b1-d2e327f42037" released by "delete_volume" :: held 2.510s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:04 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973" returned: 0 in 1.094s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:04 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 is being set with open permissions: ugo+rw Jul 06 12:17:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:04 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:04 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 Jul 06 12:17:04 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-35838be4-d8a7-4a8f-b2e2-6b9824ac6077" returned: 0 in 1.077s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-quobyte-35838be4-d8a7-4a8f-b2e2-6b9824ac6077" released by "delete_volume" :: held 2.377s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:04 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Created reservations ['ca88c278-9244-4c21-a985-3b4ea89d6f17', '5fdc833d-b773-4dca-acf1-705b07b38f4b', '86f7728b-3b4d-47b5-b409-0e3dbae313b3', '8ee41619-bea3-41be-9806-b0d67e97d85b'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:04 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Created reservations ['5f4637b3-14c5-43da-b765-304ff568dfad', 'dffb55f2-6839-4d2f-ba87-096925b22359', '4695d89e-2b1b-48cd-973c-4da8b500100b', 'd8375364-a3a6-447e-a8af-d36fd448e825'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:05 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:17:05 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:05 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:17:05 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:05 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973" returned: 0 in 1.175s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "cinder-405bf544-4a6d-4544-98a1-e134f4639f7f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-405bf544-4a6d-4544-98a1-e134f4639f7f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:06 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.info Jul 06 12:17:06 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:06 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:06 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.037s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.113s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Deleted volume successfully. Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "cinder-quobyte-405bf544-4a6d-4544-98a1-e134f4639f7f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-quobyte-405bf544-4a6d-4544-98a1-e134f4639f7f" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-02be5544-2ae2-4eeb-81f4-d693a755a77b tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-35838be4-d8a7-4a8f-b2e2-6b9824ac6077-delete_volume" released by "delete_volume" :: held 3.839s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Deleted volume successfully. Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afb9ab5-35eb-4b0f-8121-db4e98d71381]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1d3b33a5-f7d9-4b57-8f0a-b2011db6a4f2 tempest-VolumesListAdminTestJSON-771255695 None] Lock "cinder-068cc443-658d-4f27-81b1-d2e327f42037-delete_volume" released by "delete_volume" :: held 4.080s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:06 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f Jul 06 12:17:06 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:06 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.info" returned: 0 in 0.900s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:06 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.info is being set with open permissions: ugo+rw Jul 06 12:17:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:06 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.info Jul 06 12:17:06 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:07 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f" returned: 0 in 0.980s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:07 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f Jul 06 12:17:07 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:07 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.info" returned: 0 in 0.775s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.413s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.542s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-554269954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe713a9-45b2-4e66-9b00-c39d64aaab71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62351269906e4eb89cdd7f19dabf614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:01Z,use_quota=True,user_id='005fa582872a4f5b9a074e161f10553e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Creating volume 6fe713a9-45b2-4e66-9b00-c39d64aaab71 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:07 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:07 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71 1073741824 Jul 06 12:17:07 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9a8bf995-8ef0-4cab-8618-a246249b35e7 tempest-SnapshotMetadataTestJSON-1171017621 None] Create snapshot completed successfully Jul 06 12:17:07 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-405bf544-4a6d-4544-98a1-e134f4639f7f" returned: 0 in 0.758s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-quobyte-405bf544-4a6d-4544-98a1-e134f4639f7f" released by "delete_volume" :: held 1.816s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Created reservations ['3a29e559-734f-40bf-b690-c44a8c0713ed', '5f577ea5-bd34-4fa8-a666-7287572d49d0', '6f15b229-a250-4946-a839-4ccd1fd8b91f', '3a6f3e64-dd6e-474f-8e00-b005157c9b89'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:08 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:17:08 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "cinder-4a5a7385-b926-4c30-bac7-19ac6b237858-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-4a5a7385-b926-4c30-bac7-19ac6b237858-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "cinder-quobyte-4a5a7385-b926-4c30-bac7-19ac6b237858" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-quobyte-4a5a7385-b926-4c30-bac7-19ac6b237858" acquired by "delete_volume" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5baa29-555f-433c-9bb3-3abe562b2729]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:08 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858 Jul 06 12:17:08 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:09 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Acquiring lock "cinder-ba5d92a2-56fd-487d-aa67-576aa0644973-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71 1073741824" returned: 0 in 1.388s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "cinder-ba5d92a2-56fd-487d-aa67-576aa0644973-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Acquiring lock "cinder-quobyte-b24e5fcd-0a23-470d-83d3-2d7986593a03" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "cinder-quobyte-b24e5fcd-0a23-470d-83d3-2d7986593a03" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Acquiring lock "cinder-quobyte-ba5d92a2-56fd-487d-aa67-576aa0644973" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "cinder-quobyte-ba5d92a2-56fd-487d-aa67-576aa0644973" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Deleting offline snapshot ba5d92a2-56fd-487d-aa67-576aa0644973 of volume b24e5fcd-0a23-470d-83d3-2d7986593a03 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:17:09 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71 Jul 06 12:17:09 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] snapshot_file for this snap is: volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[50807eaa-5121-4a9e-8252-5015a4f043f2]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:09 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.393s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:09 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 Jul 06 12:17:09 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Deleted volume successfully. Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-03545f1f-d873-44d1-b67e-c1b32a0feb7c tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-405bf544-4a6d-4544-98a1-e134f4639f7f-delete_volume" released by "delete_volume" :: held 3.571s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:09 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858" returned: 0 in 1.242s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:10 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858 Jul 06 12:17:10 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:10 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71" returned: 0 in 0.977s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] <== create_volume: return (2521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.524s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f5ae68-6e6d-4784-b9f6-69fecda7ac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9914973-9063-4f3e-93f9-76a6420e3b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:10 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Volume volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71 (6fe713a9-45b2-4e66-9b00-c39d64aaab71): created successfully Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9914973-9063-4f3e-93f9-76a6420e3b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Flow 'volume_create_manager' (580ff11e-16fa-43a8-985a-0b350c4ebe82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-363b7459-0257-4511-8380-55f688a815bc tempest-VolumesListTestJSON-1902203834 None] Created volume successfully. Jul 06 12:17:10 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973" returned: 0 in 1.212s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b24e5fcd-0a23-470d-83d3-2d7986593a03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[61534bf1-111d-48dd-97ec-ff092f86f1bc]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:10 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 Jul 06 12:17:10 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:10 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a5a7385-b926-4c30-bac7-19ac6b237858" returned: 0 in 0.995s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-quobyte-4a5a7385-b926-4c30-bac7-19ac6b237858" released by "delete_volume" :: held 2.319s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Created reservations ['76377536-b89c-4c13-9efb-90f9f89b6077', '59059a43-29e7-4961-a924-f9a6c0003b01', 'a4ecf732-b8e2-4579-b24d-07a70ad3f472', '0a80b766-3f58-4a79-8ff8-6c4a10130bb1'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:11 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:17:11 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Flow 'volume_create_manager' (6e2e250c-f0ef-42b6-bdcb-a27a830ed006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a2492e-a7d5-4c23-9e9f-0d1f92ce415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a2492e-a7d5-4c23-9e9f-0d1f92ce415e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-38255393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba740f85-6384-47dd-95a6-67cd3a6a2909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62351269906e4eb89cdd7f19dabf614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:12Z,use_quota=True,user_id='005fa582872a4f5b9a074e161f10553e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b098cc2-87f1-4b4e-bd9a-6a5282fee005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b098cc2-87f1-4b4e-bd9a-6a5282fee005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1150200-ecd9-4114-bba2-048dff7542df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1150200-ecd9-4114-bba2-048dff7542df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba740f85-6384-47dd-95a6-67cd3a6a2909', 'volume_name': 'volume-ba740f85-6384-47dd-95a6-67cd3a6a2909', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e6f974-83ba-436a-8a9e-491f90e2a37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e6f974-83ba-436a-8a9e-491f90e2a37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3628fc3-b9a1-45cc-8b69-c80cad27e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:11 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Volume ba740f85-6384-47dd-95a6-67cd3a6a2909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba740f85-6384-47dd-95a6-67cd3a6a2909', 'volume_size': 1} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-38255393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba740f85-6384-47dd-95a6-67cd3a6a2909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62351269906e4eb89cdd7f19dabf614b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:12Z,use_quota=True,user_id='005fa582872a4f5b9a074e161f10553e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Creating volume ba740f85-6384-47dd-95a6-67cd3a6a2909 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:12 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:12 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909 1073741824 Jul 06 12:17:12 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:12 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03" returned: 0 in 1.425s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:12 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 Jul 06 12:17:12 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:12 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.154s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Deleted volume successfully. Jul 06 12:17:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9618467b-f89a-4bba-938b-ae390cb52758 tempest-VolumesListAdminTestJSON-1997827684 None] Lock "cinder-4a5a7385-b926-4c30-bac7-19ac6b237858-delete_volume" released by "delete_volume" :: held 3.936s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:13 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973" returned: 0 in 1.237s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:13 devstack sudo[94000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973 Jul 06 12:17:13 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:13 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909 1073741824" returned: 0 in 1.622s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:13 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909 Jul 06 12:17:13 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:14 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03.ba5d92a2-56fd-487d-aa67-576aa0644973" returned: 0 in 0.905s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "cinder-quobyte-ba5d92a2-56fd-487d-aa67-576aa0644973" released by "_delete_snapshot" :: held 5.006s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "cinder-quobyte-b24e5fcd-0a23-470d-83d3-2d7986593a03" released by "delete_snapshot" :: held 5.091s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Created reservations ['4e191c22-84f5-4551-9d66-a4c1892ea9ae', '1a57bc47-47d9-48a8-8fcb-97a15cbb943f', '71fe59c6-6686-479b-8f44-f8019a4f9d01', 'd2816bb0-7e76-4fd6-ac06-e8f1c2adeb8d'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Delete snapshot completed successfully. Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eef9a160-e4bd-4935-bcac-ff67b66657b5 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "cinder-ba5d92a2-56fd-487d-aa67-576aa0644973-delete_snapshot" released by "delete_snapshot" :: held 5.416s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:14 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909" returned: 0 in 1.050s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] <== create_volume: return (2773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.779s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3628fc3-b9a1-45cc-8b69-c80cad27e23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba740f85-6384-47dd-95a6-67cd3a6a2909', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2d588c-d687-437f-9e50-9341807a3e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:14 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Volume volume-ba740f85-6384-47dd-95a6-67cd3a6a2909 (ba740f85-6384-47dd-95a6-67cd3a6a2909): created successfully Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd2d588c-d687-437f-9e50-9341807a3e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Flow 'volume_create_manager' (6e2e250c-f0ef-42b6-bdcb-a27a830ed006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d3ceed56-ef3c-4437-a613-2d18d68a54ba tempest-VolumesListTestJSON-1902203834 None] Created volume successfully. Jul 06 12:17:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Acquiring lock "cinder-b24e5fcd-0a23-470d-83d3-2d7986593a03-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "cinder-b24e5fcd-0a23-470d-83d3-2d7986593a03-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Acquiring lock "cinder-quobyte-b24e5fcd-0a23-470d-83d3-2d7986593a03" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "cinder-quobyte-b24e5fcd-0a23-470d-83d3-2d7986593a03" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:16 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2a9684-9b3b-4f5c-9e5b-b0498c4432db]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:16 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 Jul 06 12:17:16 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:17 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03" returned: 0 in 1.261s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:17 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03 Jul 06 12:17:17 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:18 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b24e5fcd-0a23-470d-83d3-2d7986593a03" returned: 0 in 1.060s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "cinder-quobyte-b24e5fcd-0a23-470d-83d3-2d7986593a03" released by "delete_volume" :: held 2.425s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "cinder-ba740f85-6384-47dd-95a6-67cd3a6a2909-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-ba740f85-6384-47dd-95a6-67cd3a6a2909-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Created reservations ['d9ec9d00-e254-4121-b687-38131e83a43b', '946071a0-bd19-4af7-a1d3-236d7a71038b', 'd000ad43-12a1-4836-98ba-4dee04fe2326', '822271fe-c0b2-44a2-af92-973570adca70'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "cinder-quobyte-ba740f85-6384-47dd-95a6-67cd3a6a2909" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-quobyte-ba740f85-6384-47dd-95a6-67cd3a6a2909" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fba26d-a830-4835-a2cc-2af1050a8c96]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:18 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:17:18 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:18 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909 Jul 06 12:17:18 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Flow 'volume_create_manager' (9945ee6e-229e-47cc-8696-22c85a8b9f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b37140-b451-4409-b4e8-29b624077d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b37140-b451-4409-b4e8-29b624077d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1856094255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e19c8bf-1249-42bb-9184-eb47dd39ff78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28e15b0acf648eeace9af3a50c56b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:19Z,use_quota=True,user_id='23bb25b378154393b0167471ffd335a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86736769-91fc-40ec-a657-eb74c2ef375a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86736769-91fc-40ec-a657-eb74c2ef375a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad7369b-c804-42a0-a909-ae7bacfe94c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:17:19 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.863s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Deleted volume successfully. Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad7369b-c804-42a0-a909-ae7bacfe94c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e19c8bf-1249-42bb-9184-eb47dd39ff78', 'volume_name': 'volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1febde-efba-4c21-a22b-951e5a6567e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1febde-efba-4c21-a22b-951e5a6567e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4396f54b-330d-44f7-b7fe-4f609be306f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:19 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Volume 5e19c8bf-1249-42bb-9184-eb47dd39ff78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Trying to clone 5e19c8bf-1249-42bb-9184-eb47dd39ff78 from image b5606d26-431d-46eb-8401-a0b1e0a3d067 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8d805fd6-2a2b-4169-9aee-fb4de5c8f098 tempest-SnapshotMetadataTestJSON-1171017621 None] Lock "cinder-b24e5fcd-0a23-470d-83d3-2d7986593a03-delete_volume" released by "delete_volume" :: held 3.756s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:19 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909" returned: 0 in 1.171s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:19 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909 Jul 06 12:17:19 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:20 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:17:20 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Image download 20.69 MB at 20.69 MB/s Jul 06 12:17:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae84d9e7-41ca-4d5b-9e51-143d2a1cb0fe]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:20 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD Jul 06 12:17:20 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:20 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba740f85-6384-47dd-95a6-67cd3a6a2909" returned: 0 in 0.985s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-quobyte-ba740f85-6384-47dd-95a6-67cd3a6a2909" released by "delete_volume" :: held 2.213s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Created reservations ['6b3d364b-c3f5-4210-b7d3-7538159a89c3', '41c381ee-b8cd-4c04-aa29-af8a67d54052', '5597157c-b3ac-480f-80e4-199f5d4bc1df', 'e947eaee-f8a5-4e72-b148-27cca288037f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:21 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:17:21 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:21 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD" returned: 0 in 1.133s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:21 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Temporary image b5606d26-431d-46eb-8401-a0b1e0a3d067 is fetched for user 23bb25b378154393b0167471ffd335a7. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:17:21 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[24778b7f-7066-409e-afe1-a4f5b4630513]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:21 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD Jul 06 12:17:21 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "cinder-6fe713a9-45b2-4e66-9b00-c39d64aaab71-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-6fe713a9-45b2-4e66-9b00-c39d64aaab71-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "cinder-quobyte-6fe713a9-45b2-4e66-9b00-c39d64aaab71" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-quobyte-6fe713a9-45b2-4e66-9b00-c39d64aaab71" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:22 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.319s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Deleted volume successfully. Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1783e273-5f4c-47ed-918b-03d924e57b8d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9cead9b1-b422-47b1-a7b3-7a36d9c1bae3 tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-ba740f85-6384-47dd-95a6-67cd3a6a2909-delete_volume" released by "delete_volume" :: held 3.910s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:22 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71 Jul 06 12:17:22 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:22 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD" returned: 0 in 1.312s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1856094255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e19c8bf-1249-42bb-9184-eb47dd39ff78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28e15b0acf648eeace9af3a50c56b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:19Z,use_quota=True,user_id='23bb25b378154393b0167471ffd335a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Creating volume 5e19c8bf-1249-42bb-9184-eb47dd39ff78 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:22 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:17:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:22 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 1073741824 Jul 06 12:17:22 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:23 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71" returned: 0 in 1.471s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:24 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71 Jul 06 12:17:24 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:24 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 1073741824" returned: 0 in 1.537s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:24 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 Jul 06 12:17:24 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:25 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fe713a9-45b2-4e66-9b00-c39d64aaab71" returned: 0 in 1.180s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-quobyte-6fe713a9-45b2-4e66-9b00-c39d64aaab71" released by "delete_volume" :: held 2.751s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Created reservations ['93e546e5-23d4-40f1-bde6-5f59dab82b9a', 'd13d955f-f76c-4cdd-8577-f75ca850a374', '667349ab-e50c-4f07-a2a0-63e7dad27642', '4b5a3823-a5e2-421d-abc7-d95898d71501'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:25 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:17:25 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:25 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78" returned: 0 in 1.118s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] <== create_volume: return (2733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.745s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Attempting download of b5606d26-431d-46eb-8401-a0b1e0a3d067 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}])) to volume 5e19c8bf-1249-42bb-9184-eb47dd39ff78. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62f7796-52f5-488f-a157-abc35c32e5cf]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_gh3tezvl {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:26 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_gh3tezvl Jul 06 12:17:26 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "cinder-e89ef140-d539-4900-88ae-0c98c7d998a4-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-e89ef140-d539-4900-88ae-0c98c7d998a4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "cinder-quobyte-e89ef140-d539-4900-88ae-0c98c7d998a4" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-quobyte-e89ef140-d539-4900-88ae-0c98c7d998a4" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb4a9cb-a160-4baf-b715-ee8f86d0e39d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:26 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4 Jul 06 12:17:26 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:26 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.182s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Deleted volume successfully. Jul 06 12:17:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fb502d0a-c38e-4b18-b9ed-319f269cc30f tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-6fe713a9-45b2-4e66-9b00-c39d64aaab71-delete_volume" released by "delete_volume" :: held 4.429s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:27 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_gh3tezvl" returned: 0 in 1.354s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_gh3tezvl {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:27 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_gh3tezvl Jul 06 12:17:27 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:27 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4" returned: 0 in 1.293s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:27 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4 Jul 06 12:17:27 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:28 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_gh3tezvl" returned: 1 in 1.115s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_gh3tezvl' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f699ac0-261d-4a93-ae18-4521c9b2dfb9]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:28 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD Jul 06 12:17:28 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:28 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e89ef140-d539-4900-88ae-0c98c7d998a4" returned: 0 in 1.021s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-quobyte-e89ef140-d539-4900-88ae-0c98c7d998a4" released by "delete_volume" :: held 2.397s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Created reservations ['4c5bf4d3-187b-4aa3-8e3d-56e7987c4042', 'b6ef9566-c37b-42fe-aacf-ed52b134ec60', '825958d0-896b-4db2-9d3b-fd6f740d971e', 'f8c64497-ce43-4769-ac76-c9e2ff3bf022'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:28 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:17:28 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:29 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD" returned: 0 in 0.966s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:29 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] b5606d26-431d-46eb-8401-a0b1e0a3d067 was qcow2, converting to raw {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:17:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:29 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 Jul 06 12:17:29 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:30 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.278s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:30 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Deleted volume successfully. Jul 06 12:17:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-21181f1a-02f1-4006-acdd-e5a950e3f51c tempest-VolumesListTestJSON-1902203834 None] Lock "cinder-e89ef140-d539-4900-88ae-0c98c7d998a4-delete_volume" released by "delete_volume" :: held 4.085s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:17:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:32 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:17:32 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:33 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78" returned: 0 in 4.055s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:33 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_bbka1keidevstack@QuobyteHD, size 112.00 MB, duration 4.06 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:17:33 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Converted 112.00 MB image at 27.60 MB/s Jul 06 12:17:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:33 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 1G Jul 06 12:17:33 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:34 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 2.039s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:34 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:17:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:17:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:17:35 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 1G" returned: 0 in 2.497s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bce10b-8c49-4809-a87a-9a012b768bb3]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:36 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 Jul 06 12:17:36 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:37 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78" returned: 0 in 1.626s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:37 devstack sudo[94214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 Jul 06 12:17:37 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:38 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78" returned: 1 in 1.358s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:17:38 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Downloaded image b5606d26-431d-46eb-8401-a0b1e0a3d067 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}])) to volume 5e19c8bf-1249-42bb-9184-eb47dd39ff78 successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:17:38 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Temporary image b5606d26-431d-46eb-8401-a0b1e0a3d067 for user 23bb25b378154393b0167471ffd335a7 is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:17:38 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Marking volume 5e19c8bf-1249-42bb-9184-eb47dd39ff78 as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:17:38 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Copying metadata from image b5606d26-431d-46eb-8401-a0b1e0a3d067 to 5e19c8bf-1249-42bb-9184-eb47dd39ff78. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:17:38 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Creating volume glance metadata for volume 5e19c8bf-1249-42bb-9184-eb47dd39ff78 backed by image b5606d26-431d-46eb-8401-a0b1e0a3d067 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:17:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4396f54b-330d-44f7-b7fe-4f609be306f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efe8792-60d2-4899-a6d4-222104cc917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:39 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Volume volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 (5e19c8bf-1249-42bb-9184-eb47dd39ff78): created successfully Jul 06 12:17:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efe8792-60d2-4899-a6d4-222104cc917b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Flow 'volume_create_manager' (9945ee6e-229e-47cc-8696-22c85a8b9f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7f5def6d-cc59-43a4-8483-a61975569c07 tempest-VolumesImageMetadata-294637028 None] Created volume successfully. Jul 06 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Acquiring lock "cinder-5e19c8bf-1249-42bb-9184-eb47dd39ff78-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Lock "cinder-5e19c8bf-1249-42bb-9184-eb47dd39ff78-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Acquiring lock "cinder-quobyte-5e19c8bf-1249-42bb-9184-eb47dd39ff78" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Lock "cinder-quobyte-5e19c8bf-1249-42bb-9184-eb47dd39ff78" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c88b837-5f1a-4a37-ba9a-e6775e1b36bb]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:41 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 Jul 06 12:17:41 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Flow 'volume_create_manager' (0b48fe07-30d6-4b54-9529-41304d1e30da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba4fcc2-0820-4ce6-b6a4-7f8a9f1df7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba4fcc2-0820-4ce6-b6a4-7f8a9f1df7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-577880341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5361ca6e-e22a-4d8d-88a1-e27a088b6741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85481395049f448cb7d4262776e82c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:42Z,use_quota=True,user_id='c609908b7e6243c7b579a30b5631c5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d2384c-1964-418c-a833-f2b543e71282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d2384c-1964-418c-a833-f2b543e71282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3fce4c2-fe22-474d-bbf0-042458b9d353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3fce4c2-fe22-474d-bbf0-042458b9d353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5361ca6e-e22a-4d8d-88a1-e27a088b6741', 'volume_name': 'volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c492c96-5adc-44ae-b72e-e805a43eb3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c492c96-5adc-44ae-b72e-e805a43eb3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa963650-ed12-488f-a9a1-e92fb002d6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:42 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Volume 5361ca6e-e22a-4d8d-88a1-e27a088b6741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741', 'volume_size': 1} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-577880341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5361ca6e-e22a-4d8d-88a1-e27a088b6741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85481395049f448cb7d4262776e82c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:42Z,use_quota=True,user_id='c609908b7e6243c7b579a30b5631c5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Creating volume 5361ca6e-e22a-4d8d-88a1-e27a088b6741 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:42 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:17:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:42 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 1073741824 Jul 06 12:17:42 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:43 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78" returned: 0 in 2.180s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:43 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 Jul 06 12:17:43 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:44 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78" returned: 1 in 1.382s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:44 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78 Jul 06 12:17:44 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:44 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 1073741824" returned: 0 in 1.931s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:44 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 Jul 06 12:17:44 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:45 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5e19c8bf-1249-42bb-9184-eb47dd39ff78" returned: 0 in 1.555s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Lock "cinder-quobyte-5e19c8bf-1249-42bb-9184-eb47dd39ff78" released by "delete_volume" :: held 5.254s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Created reservations ['be21d40e-e7c8-4775-836c-9a31dda2d824', '8b5e52c8-a1d6-4222-b38c-40fcdab59f6a', '39b77ed0-43e0-4793-b0be-c9c10af99014', '4fec57f7-9ca0-44ab-a18f-6bea19a6cf69'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:46 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741" returned: 0 in 1.499s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] <== create_volume: return (3553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.556s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa963650-ed12-488f-a9a1-e92fb002d6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9efecdf-7817-4cd8-8424-08ccd4afa49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:46 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Volume volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 (5361ca6e-e22a-4d8d-88a1-e27a088b6741): created successfully Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9efecdf-7817-4cd8-8424-08ccd4afa49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Flow 'volume_create_manager' (0b48fe07-30d6-4b54-9529-41304d1e30da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1eb9b3e7-7864-4df8-8278-0419e670fc29 tempest-VolumesActionsTest-1593358972 None] Created volume successfully. Jul 06 12:17:46 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:17:46 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:47 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.090s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:17:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Deleted volume successfully. Jul 06 12:17:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e1bda3f9-d6a7-4a7a-9623-b32bd8c20422 tempest-VolumesImageMetadata-294637028 None] Lock "cinder-5e19c8bf-1249-42bb-9184-eb47dd39ff78-delete_volume" released by "delete_volume" :: held 6.859s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Flow 'volume_create_manager' (22e99e79-3e5e-4402-906d-a37a12a99388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef27fa40-3040-4aae-8b68-7ffedaa2b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef27fa40-3040-4aae-8b68-7ffedaa2b56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1665152983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5224db3753347ec8f62f276431a4b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:53Z,use_quota=True,user_id='772e583bb3d4499f827981febf932f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42952e90-76bd-4b55-b6b9-c2cc0808c0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42952e90-76bd-4b55-b6b9-c2cc0808c0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951024fd-b544-4a18-84c1-fe82065f1c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951024fd-b544-4a18-84c1-fe82065f1c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf', 'volume_name': 'volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b55f15d-2a5a-41e0-a9c0-c776270e29d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b55f15d-2a5a-41e0-a9c0-c776270e29d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a45d9bd-703e-4e0b-8847-0754e4f3a4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Volume b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf', 'volume_size': 1} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1665152983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5224db3753347ec8f62f276431a4b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:53Z,use_quota=True,user_id='772e583bb3d4499f827981febf932f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Creating volume b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:53 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:17:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:53 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf 1073741824 Jul 06 12:17:53 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:54 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf 1073741824" returned: 0 in 1.274s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:54 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf Jul 06 12:17:54 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:55 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf" returned: 0 in 1.080s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] <== create_volume: return (2425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:55 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=84,cinder:INSERT=29,cinder:UPDATE=98,cinder:DELETE=7 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a45d9bd-703e-4e0b-8847-0754e4f3a4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c136c4-2ef4-4e94-b95f-b70a9828ce25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:55 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=114,cinder:DELETE=11,cinder:SELECT=71,cinder:INSERT=34 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:17:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Volume volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf (b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf): created successfully Jul 06 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c136c4-2ef4-4e94-b95f-b70a9828ce25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Flow 'volume_create_manager' (22e99e79-3e5e-4402-906d-a37a12a99388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-aee98ae9-4d99-409e-8d7d-b5b2731a6cf6 tempest-AbsoluteLimitsTests-1048177473 None] Created volume successfully. Jul 06 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Acquiring lock "cinder-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Lock "cinder-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Acquiring lock "cinder-quobyte-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Lock "cinder-quobyte-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:17:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8a23bd-a367-42e2-92aa-d08844d23366]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:17:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Flow 'volume_create_manager' (188d8a97-c138-4a23-a347-bcc5a326c10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7124cf-dca6-437c-835e-f51df560841f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7124cf-dca6-437c-835e-f51df560841f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-883764417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1a6f71-8c71-4975-b771-7242dc53b51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8085737e6dbd48da8529322a92b4fdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:57Z,use_quota=True,user_id='54a623346f2e468dae020fbcbd96ae3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34990b44-8cb1-4206-b796-570bbb73baa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34990b44-8cb1-4206-b796-570bbb73baa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec8f89a-49a3-4c73-b7e2-052a13cb1ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec8f89a-49a3-4c73-b7e2-052a13cb1ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1a6f71-8c71-4975-b771-7242dc53b51e', 'volume_name': 'volume-4c1a6f71-8c71-4975-b771-7242dc53b51e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b0d796-e90e-458d-938a-6f5666910557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b0d796-e90e-458d-938a-6f5666910557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:57 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08447357-4b69-4e5e-ac35-f09054c6f23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:57 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Volume 4c1a6f71-8c71-4975-b771-7242dc53b51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1a6f71-8c71-4975-b771-7242dc53b51e', 'volume_size': 1} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-883764417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1a6f71-8c71-4975-b771-7242dc53b51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8085737e6dbd48da8529322a92b4fdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:17:57Z,use_quota=True,user_id='54a623346f2e468dae020fbcbd96ae3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Creating volume 4c1a6f71-8c71-4975-b771-7242dc53b51e {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:17:57 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:17:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:57 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e 1073741824 Jul 06 12:17:57 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:58 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf" returned: 0 in 1.560s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:58 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf Jul 06 12:17:58 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:58 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e 1073741824" returned: 0 in 1.395s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:58 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e Jul 06 12:17:58 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:17:59 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf" returned: 0 in 1.189s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Lock "cinder-quobyte-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf" released by "delete_volume" :: held 2.849s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Created reservations ['6ffd5c6b-e380-40be-b36e-9523160d0e99', '65a21243-fa70-4e17-bbde-9aea5333d9c0', '9382a95e-33f5-43cb-b781-e48fee532768', 'd53bc775-0eac-43b8-80ae-ecf554730fc6'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:17:59 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e" returned: 0 in 1.135s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] <== create_volume: return (2620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.626s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08447357-4b69-4e5e-ac35-f09054c6f23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1a6f71-8c71-4975-b771-7242dc53b51e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83d2bcb-f20a-4c35-af3f-c1fd5d6f6b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:17:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Volume volume-4c1a6f71-8c71-4975-b771-7242dc53b51e (4c1a6f71-8c71-4975-b771-7242dc53b51e): created successfully Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83d2bcb-f20a-4c35-af3f-c1fd5d6f6b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Flow 'volume_create_manager' (188d8a97-c138-4a23-a347-bcc5a326c10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:17:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cd255254-5efc-4aca-8ea7-4aa03a1b9dc2 tempest-AttachVolumeTestJSON-600723819 None] Created volume successfully. Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:17:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:17:59 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:17:59 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:01 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.259s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:01 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Deleted volume successfully. Jul 06 12:18:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6e5c0521-6873-4ca2-98df-e2df9acbaf80 tempest-AbsoluteLimitsTests-1048177473 None] Lock "cinder-b7cd4511-75a3-4fb6-a323-7f35bcd4d0cf-delete_volume" released by "delete_volume" :: held 4.595s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-3b1d33a3-a701-4827-a0c1-6a9a80958890 req-d613729c-05d6-45f6-8a9b-1405575a6d4a tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-3b1d33a3-a701-4827-a0c1-6a9a80958890 req-d613729c-05d6-45f6-8a9b-1405575a6d4a tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65e278f-0c4f-4910-8a16-8bd6bb5697e6]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-3b1d33a3-a701-4827-a0c1-6a9a80958890 req-d613729c-05d6-45f6-8a9b-1405575a6d4a tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:04 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e Jul 06 12:18:04 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:05 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-3b1d33a3-a701-4827-a0c1-6a9a80958890 req-d613729c-05d6-45f6-8a9b-1405575a6d4a tempest-AttachVolumeTestJSON-600723819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e" returned: 0 in 1.467s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-3b1d33a3-a701-4827-a0c1-6a9a80958890 req-d613729c-05d6-45f6-8a9b-1405575a6d4a tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.500s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-3b1d33a3-a701-4827-a0c1-6a9a80958890 req-d613729c-05d6-45f6-8a9b-1405575a6d4a tempest-AttachVolumeTestJSON-600723819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-4c1a6f71-8c71-4975-b771-7242dc53b51e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9cebbf8-1454-49d6-a7d8-944b3f27e294', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:18:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-3b1d33a3-a701-4827-a0c1-6a9a80958890 req-d613729c-05d6-45f6-8a9b-1405575a6d4a tempest-AttachVolumeTestJSON-600723819 None] attachment_update completed successfully. Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-278fbed4-0439-494b-ad79-d687ba034d16 tempest-VolumesActionsTest-1593358972 None] Acquiring lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741" by "attach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-278fbed4-0439-494b-ad79-d687ba034d16 tempest-VolumesActionsTest-1593358972 None] Lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741" acquired by "attach_volume" :: waited 0.044s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-278fbed4-0439-494b-ad79-d687ba034d16 tempest-VolumesActionsTest-1593358972 None] Attaching volume 5361ca6e-e22a-4d8d-88a1-e27a088b6741 to instance 4cdb8ed3-9341-4c4a-aca1-00684a30c462 at mountpoint /dev/vdb on host None. Jul 06 12:18:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-278fbed4-0439-494b-ad79-d687ba034d16 tempest-VolumesActionsTest-1593358972 None] Attach volume completed successfully. Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-278fbed4-0439-494b-ad79-d687ba034d16 tempest-VolumesActionsTest-1593358972 None] Lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741" released by "attach_volume" :: held 0.173s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Flow 'volume_create_manager' (f26ce1ff-9834-4959-b451-8b56c2377577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7317c862-1f62-492e-80be-31de5c4b53f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7317c862-1f62-492e-80be-31de5c4b53f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1992731876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1f2b11-6757-46f5-9e55-824e8fce7322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6522a8a0255545b9ae16ed817c1e6588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:13Z,use_quota=True,user_id='25637414a773414b9559aa21b2900364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2149cf3-dc3c-495d-afea-0b090d122293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2149cf3-dc3c-495d-afea-0b090d122293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da39005-cbdb-4645-821e-b89cbbf496a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da39005-cbdb-4645-821e-b89cbbf496a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e1f2b11-6757-46f5-9e55-824e8fce7322', 'volume_name': 'volume-3e1f2b11-6757-46f5-9e55-824e8fce7322', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5feda20-3d9b-4571-9726-cde2a92e7187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5feda20-3d9b-4571-9726-cde2a92e7187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e1fb14-5495-4dda-a6d1-e26a91d7abcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:13 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Volume 3e1f2b11-6757-46f5-9e55-824e8fce7322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e1f2b11-6757-46f5-9e55-824e8fce7322', 'volume_size': 1} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1992731876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e1f2b11-6757-46f5-9e55-824e8fce7322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6522a8a0255545b9ae16ed817c1e6588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:13Z,use_quota=True,user_id='25637414a773414b9559aa21b2900364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Creating volume 3e1f2b11-6757-46f5-9e55-824e8fce7322 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:13 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:13 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322 1073741824 Jul 06 12:18:13 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99dd7cbc-c48c-48d1-95cd-d5b3bb66cd0b tempest-VolumesActionsTest-1593358972 None] Acquiring lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741-detach_volume" by "detach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99dd7cbc-c48c-48d1-95cd-d5b3bb66cd0b tempest-VolumesActionsTest-1593358972 None] Lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-99dd7cbc-c48c-48d1-95cd-d5b3bb66cd0b tempest-VolumesActionsTest-1593358972 None] Detaching volume 5361ca6e-e22a-4d8d-88a1-e27a088b6741 from instance 4cdb8ed3-9341-4c4a-aca1-00684a30c462. Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Flow 'volume_create_manager' (4f104b15-2c82-4403-ba32-04da2a6dc76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8b10a4-4df3-472d-8ad8-dea8ebc2a361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8b10a4-4df3-472d-8ad8-dea8ebc2a361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1799301184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8085737e6dbd48da8529322a92b4fdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:13Z,use_quota=True,user_id='54a623346f2e468dae020fbcbd96ae3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95403556-ff2c-493a-b31e-bc641d759843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95403556-ff2c-493a-b31e-bc641d759843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad50155f-aecc-496e-a7b1-accd3d01d120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad50155f-aecc-496e-a7b1-accd3d01d120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5', 'volume_name': 'volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb11c7fd-3bc8-44ee-8bfa-69a03bca69b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb11c7fd-3bc8-44ee-8bfa-69a03bca69b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc462428-bb10-40f4-abc6-64ee4e4df9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:13 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Volume ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5', 'volume_size': 1} Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-99dd7cbc-c48c-48d1-95cd-d5b3bb66cd0b tempest-VolumesActionsTest-1593358972 None] Detach volume completed successfully. Jul 06 12:18:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-99dd7cbc-c48c-48d1-95cd-d5b3bb66cd0b tempest-VolumesActionsTest-1593358972 None] Lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741-detach_volume" released by "detach_volume" :: held 0.450s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:14 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322 1073741824" returned: 0 in 1.761s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:14 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322 Jul 06 12:18:14 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:15 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322" returned: 0 in 0.915s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] <== create_volume: return (2741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.746s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.999s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1799301184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8085737e6dbd48da8529322a92b4fdb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:13Z,use_quota=True,user_id='54a623346f2e468dae020fbcbd96ae3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Creating volume ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:15 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e1fb14-5495-4dda-a6d1-e26a91d7abcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e1f2b11-6757-46f5-9e55-824e8fce7322', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0de9e8-4de0-4e9f-9289-e1107be1cbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:15 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 1073741824 Jul 06 12:18:15 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Volume volume-3e1f2b11-6757-46f5-9e55-824e8fce7322 (3e1f2b11-6757-46f5-9e55-824e8fce7322): created successfully Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0de9e8-4de0-4e9f-9289-e1107be1cbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Flow 'volume_create_manager' (f26ce1ff-9834-4959-b451-8b56c2377577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-170c7ff3-4e29-43f9-9fab-38653d35958b tempest-VolumesTransfersTest-616979270 None] Created volume successfully. Jul 06 12:18:17 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 1073741824" returned: 0 in 1.766s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:17 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 Jul 06 12:18:17 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9479ea00-a28e-42e1-a06e-6147d61e667c tempest-VolumesTransfersTest-909341020 None] Transfer volume completed successfully. Jul 06 12:18:18 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5" returned: 0 in 1.005s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] <== create_volume: return (2851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.854s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc462428-bb10-40f4-abc6-64ee4e4df9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663b6f48-0629-403f-9fa0-67d4ef1a0065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Volume volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 (ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5): created successfully Jul 06 12:18:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663b6f48-0629-403f-9fa0-67d4ef1a0065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Flow 'volume_create_manager' (4f104b15-2c82-4403-ba32-04da2a6dc76c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8eca3250-5da8-40f1-abd8-8ea3cb366a24 tempest-AttachVolumeTestJSON-600723819 None] Created volume successfully. Jul 06 12:18:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Acquiring lock "cinder-3e1f2b11-6757-46f5-9e55-824e8fce7322-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Lock "cinder-3e1f2b11-6757-46f5-9e55-824e8fce7322-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Acquiring lock "cinder-quobyte-3e1f2b11-6757-46f5-9e55-824e8fce7322" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Lock "cinder-quobyte-3e1f2b11-6757-46f5-9e55-824e8fce7322" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4edffa-b3fe-4856-957b-57d3c8c67d0f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:19 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322 Jul 06 12:18:19 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:20 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322" returned: 0 in 1.012s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:20 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322 Jul 06 12:18:20 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:21 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3e1f2b11-6757-46f5-9e55-824e8fce7322" returned: 0 in 1.079s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Lock "cinder-quobyte-3e1f2b11-6757-46f5-9e55-824e8fce7322" released by "delete_volume" :: held 2.171s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Created reservations ['731e9ace-7061-4d6e-aad3-33df7376cb12', 'caf4faac-57ca-42f0-9dec-d92f360efa67', '848b2d7f-cedf-4528-99c1-e14ba470e33c', '9ed0fd5d-eadb-4876-b254-4a95ae1afc22'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:21 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:18:21 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-c4590395-a0af-4e8c-9b23-bf7848f82ef2 req-ed982ddc-3c2d-41ff-893d-371909edf2de tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-c4590395-a0af-4e8c-9b23-bf7848f82ef2 req-ed982ddc-3c2d-41ff-893d-371909edf2de tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ce6af1-4071-4ef7-9373-653228f64124]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-c4590395-a0af-4e8c-9b23-bf7848f82ef2 req-ed982ddc-3c2d-41ff-893d-371909edf2de tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:22 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.042s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:22 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Deleted volume successfully. Jul 06 12:18:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1775a777-1e46-447c-b342-39db4174dd5b tempest-VolumesTransfersTest-840614201 None] Lock "cinder-3e1f2b11-6757-46f5-9e55-824e8fce7322-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:23 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 Jul 06 12:18:23 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Flow 'volume_create_manager' (c31adf45-dc34-4228-8037-981d66c4fead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c46e32-1e97-4b2a-930f-27c76d1b2044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c46e32-1e97-4b2a-930f-27c76d1b2044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2070568955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4466190-0fb8-4369-90a4-66dcd639407b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6522a8a0255545b9ae16ed817c1e6588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:23Z,use_quota=True,user_id='25637414a773414b9559aa21b2900364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad38b6b-db49-4205-9e15-685abb41fb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad38b6b-db49-4205-9e15-685abb41fb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25bed18-1643-4a45-a556-d03397679402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25bed18-1643-4a45-a556-d03397679402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4466190-0fb8-4369-90a4-66dcd639407b', 'volume_name': 'volume-c4466190-0fb8-4369-90a4-66dcd639407b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6257ffde-6953-4701-ac5d-ee1ddd8e75e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6257ffde-6953-4701-ac5d-ee1ddd8e75e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab242340-bd12-4a2e-9c97-05d042e06b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Volume c4466190-0fb8-4369-90a4-66dcd639407b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4466190-0fb8-4369-90a4-66dcd639407b', 'volume_size': 1} Jul 06 12:18:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:24 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-c4590395-a0af-4e8c-9b23-bf7848f82ef2 req-ed982ddc-3c2d-41ff-893d-371909edf2de tempest-AttachVolumeTestJSON-600723819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5" returned: 0 in 1.475s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-c4590395-a0af-4e8c-9b23-bf7848f82ef2 req-ed982ddc-3c2d-41ff-893d-371909edf2de tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.518s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2070568955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4466190-0fb8-4369-90a4-66dcd639407b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6522a8a0255545b9ae16ed817c1e6588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:23Z,use_quota=True,user_id='25637414a773414b9559aa21b2900364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Creating volume c4466190-0fb8-4369-90a4-66dcd639407b {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:24 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-c4590395-a0af-4e8c-9b23-bf7848f82ef2 req-ed982ddc-3c2d-41ff-893d-371909edf2de tempest-AttachVolumeTestJSON-600723819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee9f07df-dd32-4dbb-a5da-3a9e21bce4a1', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:18:24 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b 1073741824 Jul 06 12:18:24 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-c4590395-a0af-4e8c-9b23-bf7848f82ef2 req-ed982ddc-3c2d-41ff-893d-371909edf2de tempest-AttachVolumeTestJSON-600723819 None] attachment_update completed successfully. Jul 06 12:18:25 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b 1073741824" returned: 0 in 1.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:25 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b Jul 06 12:18:25 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Flow 'volume_create_manager' (0f3fbb63-a69a-42a5-aa1a-f78902eaf16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe828376-0730-4237-a5fe-ebbfe1557578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:26 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b" returned: 0 in 0.853s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] <== create_volume: return (2226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe828376-0730-4237-a5fe-ebbfe1557578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1717938952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453bebb35d094ad59e359bcfed72d64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:26Z,use_quota=True,user_id='bf434a8e7bad46ad80e8e7babcefe918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23509bc6-2e62-4c7e-b359-9335cdc4e8b0),volume_type_id=23509bc6-2e62-4c7e-b359-9335cdc4e8b0)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44206691-78c8-4870-abd6-02a656b25167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44206691-78c8-4870-abd6-02a656b25167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bdae915-b39f-49ca-b020-a631e982cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bdae915-b39f-49ca-b020-a631e982cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3', 'volume_name': 'volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c534870f-e06f-4d5b-8467-ef4f61c991b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c534870f-e06f-4d5b-8467-ef4f61c991b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5589c2ce-c6ff-48e8-958b-6960c494bfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Volume c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3', 'volume_size': 1} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1717938952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453bebb35d094ad59e359bcfed72d64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:26Z,use_quota=True,user_id='bf434a8e7bad46ad80e8e7babcefe918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23509bc6-2e62-4c7e-b359-9335cdc4e8b0),volume_type_id=23509bc6-2e62-4c7e-b359-9335cdc4e8b0)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Creating volume c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:26 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab242340-bd12-4a2e-9c97-05d042e06b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4466190-0fb8-4369-90a4-66dcd639407b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35009ef-226c-40e4-871b-ec0284190f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:26 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 1073741824 Jul 06 12:18:26 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Volume volume-c4466190-0fb8-4369-90a4-66dcd639407b (c4466190-0fb8-4369-90a4-66dcd639407b): created successfully Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a35009ef-226c-40e4-871b-ec0284190f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Flow 'volume_create_manager' (c31adf45-dc34-4228-8037-981d66c4fead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-91da6c48-adea-460e-aa01-af8b5c49fb72 tempest-VolumesTransfersTest-616979270 None] Created volume successfully. Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Flow 'volume_create_manager' (1a81ee1a-8870-4460-80cd-579ce465149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73ac91d-b332-41a3-b5e2-59ee11ebdcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73ac91d-b332-41a3-b5e2-59ee11ebdcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-214545097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456e6080-e1a5-4d88-9910-5151a28dbf68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453bebb35d094ad59e359bcfed72d64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:27Z,use_quota=True,user_id='bf434a8e7bad46ad80e8e7babcefe918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(676feacd-ae06-41c1-9050-272f6fbe932e),volume_type_id=676feacd-ae06-41c1-9050-272f6fbe932e)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c82ff01-2ab3-4528-8182-64f9ada7c016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c82ff01-2ab3-4528-8182-64f9ada7c016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b1ae8e-7db8-4813-93b6-a5a8c0498f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b1ae8e-7db8-4813-93b6-a5a8c0498f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456e6080-e1a5-4d88-9910-5151a28dbf68', 'volume_name': 'volume-456e6080-e1a5-4d88-9910-5151a28dbf68', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25839cc4-5078-460d-8627-85f98ab13895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25839cc4-5078-460d-8627-85f98ab13895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c58efdc-ca08-407a-b85c-66b48f85c3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Volume 456e6080-e1a5-4d88-9910-5151a28dbf68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456e6080-e1a5-4d88-9910-5151a28dbf68', 'volume_size': 1} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Acquiring lock "cinder-c4466190-0fb8-4369-90a4-66dcd639407b-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Lock "cinder-c4466190-0fb8-4369-90a4-66dcd639407b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Acquiring lock "cinder-quobyte-c4466190-0fb8-4369-90a4-66dcd639407b" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Lock "cinder-quobyte-c4466190-0fb8-4369-90a4-66dcd639407b" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9de6a4e-ca3a-49c3-8c76-670dfa0a30ff]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:27 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b Jul 06 12:18:27 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:28 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 1073741824" returned: 0 in 1.535s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Flow 'volume_create_manager' (c2d8460e-43ee-4537-9409-2aefced4fe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9b882c-41ee-4df2-8328-4a5267d85675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9b882c-41ee-4df2-8328-4a5267d85675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-249206734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31fec149-2f72-4efc-b0f5-e9d686d5551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453bebb35d094ad59e359bcfed72d64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:28Z,use_quota=True,user_id='bf434a8e7bad46ad80e8e7babcefe918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a31d9a1-8004-4cd8-ab05-ba9bc1b69a1d),volume_type_id=1a31d9a1-8004-4cd8-ab05-ba9bc1b69a1d)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2038888-baaf-4ec2-8431-4bd2dabc7bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2038888-baaf-4ec2-8431-4bd2dabc7bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54826ebb-d8fe-45be-add9-730675fd2ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:28 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 Jul 06 12:18:28 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54826ebb-d8fe-45be-add9-730675fd2ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31fec149-2f72-4efc-b0f5-e9d686d5551f', 'volume_name': 'volume-31fec149-2f72-4efc-b0f5-e9d686d5551f', 'volume_size': 1, 'image_id': 'f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--392357886', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '453bebb35d094ad59e359bcfed72d64f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'created_at': datetime.datetime(2026, 7, 6, 10, 18, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 18, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0c13c75-9e53-4023-8dd2-594f2b18a0f8/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db15fffd-4125-40e9-8ba0-fe802c4ef639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db15fffd-4125-40e9-8ba0-fe802c4ef639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c85497e-cd97-432a-a4c4-f0beb672df4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:28 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Volume 31fec149-2f72-4efc-b0f5-e9d686d5551f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31fec149-2f72-4efc-b0f5-e9d686d5551f', 'volume_size': 1, 'image_id': 'f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--392357886', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '453bebb35d094ad59e359bcfed72d64f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'created_at': datetime.datetime(2026, 7, 6, 10, 18, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 18, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0c13c75-9e53-4023-8dd2-594f2b18a0f8/file', 'properties': {}}, 'image_service': } Jul 06 12:18:28 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Trying to clone 31fec149-2f72-4efc-b0f5-e9d686d5551f from image f0c13c75-9e53-4023-8dd2-594f2b18a0f8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:18:29 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b" returned: 0 in 1.316s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:29 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b Jul 06 12:18:29 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:29 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3" returned: 0 in 1.181s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] <== create_volume: return (2895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.900s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.972s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-214545097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456e6080-e1a5-4d88-9910-5151a28dbf68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453bebb35d094ad59e359bcfed72d64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:27Z,use_quota=True,user_id='bf434a8e7bad46ad80e8e7babcefe918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(676feacd-ae06-41c1-9050-272f6fbe932e),volume_type_id=676feacd-ae06-41c1-9050-272f6fbe932e)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Creating volume 456e6080-e1a5-4d88-9910-5151a28dbf68 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:29 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:29 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68 1073741824 Jul 06 12:18:29 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5589c2ce-c6ff-48e8-958b-6960c494bfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4413a05-c7af-4084-80e1-dd7d7ce5894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Volume volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 (c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3): created successfully Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4413a05-c7af-4084-80e1-dd7d7ce5894a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Flow 'volume_create_manager' (0f3fbb63-a69a-42a5-aa1a-f78902eaf16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1316be6b-49ac-40c9-88ad-c0ef24155125 tempest-TestInstancesWithCinderVolumes-1981951198 None] Created volume successfully. Jul 06 12:18:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c4466190-0fb8-4369-90a4-66dcd639407b" returned: 0 in 1.224s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:30 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Lock "cinder-quobyte-c4466190-0fb8-4369-90a4-66dcd639407b" released by "delete_volume" :: held 2.630s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:30 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Created reservations ['5cd30de6-fd39-4ec4-882f-fe960ff3a60d', '7e2407f3-3f33-4f94-950d-3a195bf626ba', '52503ed1-481b-4457-89df-fb90fd09ea65', 'c5539a54-0005-44c9-93b2-f77ae9d79588'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:30 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:18:30 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:31 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68 1073741824" returned: 0 in 2.140s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:31 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68 Jul 06 12:18:31 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-8c7be879-418f-42f5-90d9-e5a351ea0211 req-4d9ee9ca-478b-4705-858b-d3142ddd61a7 tempest-AttachVolumeTestJSON-600723819 None] Terminate volume connection completed successfully. Jul 06 12:18:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-8c7be879-418f-42f5-90d9-e5a351ea0211 req-4d9ee9ca-478b-4705-858b-d3142ddd61a7 tempest-AttachVolumeTestJSON-600723819 None] Deleting attachment e9cebbf8-1454-49d6-a7d8-944b3f27e294. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:18:32 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.463s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Deleted volume successfully. Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e78c00ae-455d-478b-a78c-46b95fab59fd tempest-VolumesTransfersTest-840614201 None] Lock "cinder-c4466190-0fb8-4369-90a4-66dcd639407b-delete_volume" released by "delete_volume" :: held 4.510s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:32 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68" returned: 0 in 1.161s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] <== create_volume: return (3412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.416s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c58efdc-ca08-407a-b85c-66b48f85c3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456e6080-e1a5-4d88-9910-5151a28dbf68', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d37916-afed-4392-bd22-99c2e661bb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:32 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:18:32 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:32 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Volume volume-456e6080-e1a5-4d88-9910-5151a28dbf68 (456e6080-e1a5-4d88-9910-5151a28dbf68): created successfully Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d37916-afed-4392-bd22-99c2e661bb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Flow 'volume_create_manager' (1a81ee1a-8870-4460-80cd-579ce465149f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-490bb8fb-e453-4d75-8b16-b69b164f1ea1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Created volume successfully. Jul 06 12:18:33 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.026s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:18:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:18:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:18:35 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD, size 20.69 MB, duration 6.52 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:18:35 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Image download 20.69 MB at 3.17 MB/s Jul 06 12:18:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[41589931-21a3-442c-9ce9-502dcdf1b452]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:35 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD Jul 06 12:18:35 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-05e607d0-5bc0-433b-a74f-55d432c0631e req-83ffa30c-1040-45a5-863d-656509355ce3 tempest-AttachVolumeTestJSON-600723819 None] Terminate volume connection completed successfully. Jul 06 12:18:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-05e607d0-5bc0-433b-a74f-55d432c0631e req-83ffa30c-1040-45a5-863d-656509355ce3 tempest-AttachVolumeTestJSON-600723819 None] Deleting attachment ee9f07df-dd32-4dbb-a5da-3a9e21bce4a1. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:18:36 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD" returned: 0 in 1.115s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:36 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Temporary image f0c13c75-9e53-4023-8dd2-594f2b18a0f8 is fetched for user bf434a8e7bad46ad80e8e7babcefe918. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:18:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8aad7d-f44a-4eab-9d5f-363577b62454]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:36 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD Jul 06 12:18:36 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:37 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD" returned: 0 in 1.136s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-249206734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31fec149-2f72-4efc-b0f5-e9d686d5551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453bebb35d094ad59e359bcfed72d64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:18:28Z,use_quota=True,user_id='bf434a8e7bad46ad80e8e7babcefe918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a31d9a1-8004-4cd8-ab05-ba9bc1b69a1d),volume_type_id=1a31d9a1-8004-4cd8-ab05-ba9bc1b69a1d)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Creating volume 31fec149-2f72-4efc-b0f5-e9d686d5551f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:18:37 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:18:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:37 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f 1073741824 Jul 06 12:18:37 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:39 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f 1073741824" returned: 0 in 1.949s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:39 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f Jul 06 12:18:39 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:40 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f" returned: 0 in 1.044s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] <== create_volume: return (3105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:18:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.114s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:40 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Attempting download of f0c13c75-9e53-4023-8dd2-594f2b18a0f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'metadata': {}}])) to volume 31fec149-2f72-4efc-b0f5-e9d686d5551f. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:18:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6e81da-dcbb-45d3-b211-94fb756a2e41]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_ep6xikp_ {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:41 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_ep6xikp_ Jul 06 12:18:41 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:43 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_ep6xikp_" returned: 0 in 2.141s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_ep6xikp_ {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:43 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_ep6xikp_ Jul 06 12:18:43 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:44 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_ep6xikp_" returned: 1 in 1.256s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_ep6xikp_' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:18:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2388d2ae-bb28-47c9-927e-792718a2b693]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:44 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD Jul 06 12:18:44 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:45 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD" returned: 0 in 0.935s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:45 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] f0c13c75-9e53-4023-8dd2-594f2b18a0f8 was qcow2, converting to raw {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:18:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:45 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f Jul 06 12:18:45 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cbd62f23-ca70-405e-9423-a108e645838d tempest-VolumesActionsTest-1593358972 None] Acquiring lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741" by "attach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cbd62f23-ca70-405e-9423-a108e645838d tempest-VolumesActionsTest-1593358972 None] Lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741" acquired by "attach_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:45 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cbd62f23-ca70-405e-9423-a108e645838d tempest-VolumesActionsTest-1593358972 None] Attaching volume 5361ca6e-e22a-4d8d-88a1-e27a088b6741 to instance 14d7116d-4882-4981-86e3-6e2cf67dab75 at mountpoint /dev/vdb on host None. Jul 06 12:18:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cbd62f23-ca70-405e-9423-a108e645838d tempest-VolumesActionsTest-1593358972 None] Attach volume completed successfully. Jul 06 12:18:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cbd62f23-ca70-405e-9423-a108e645838d tempest-VolumesActionsTest-1593358972 None] Lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741" released by "attach_volume" :: held 0.139s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f744ef22-e496-46a0-a3ef-583c4c16f2f0 tempest-VolumesActionsTest-1593358972 None] Acquiring lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741-detach_volume" by "detach_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f744ef22-e496-46a0-a3ef-583c4c16f2f0 tempest-VolumesActionsTest-1593358972 None] Lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f744ef22-e496-46a0-a3ef-583c4c16f2f0 tempest-VolumesActionsTest-1593358972 None] Detaching volume 5361ca6e-e22a-4d8d-88a1-e27a088b6741 from instance 14d7116d-4882-4981-86e3-6e2cf67dab75. Jul 06 12:18:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f744ef22-e496-46a0-a3ef-583c4c16f2f0 tempest-VolumesActionsTest-1593358972 None] Detach volume completed successfully. Jul 06 12:18:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f744ef22-e496-46a0-a3ef-583c4c16f2f0 tempest-VolumesActionsTest-1593358972 None] Lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f" returned: 0 in 3.046s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:48 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:48 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f0c13c75-9e53-4023-8dd2-594f2b18a0f8_3un09voedevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:18:48 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Converted 112.00 MB image at 36.76 MB/s Jul 06 12:18:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:48 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f 1G Jul 06 12:18:48 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:49 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f 1G" returned: 0 in 1.125s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a160c1f6-2a11-4798-ac61-f33d9aa3e8f4]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:49 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f Jul 06 12:18:49 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "cinder-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "cinder-quobyte-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-quobyte-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5" acquired by "delete_volume" :: waited 0.047s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:50 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3424190b-bd49-4eb2-ad3c-c86c4452d747]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:50 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 Jul 06 12:18:50 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:50 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f" returned: 0 in 1.233s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:50 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f Jul 06 12:18:50 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:51 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5" returned: 0 in 1.335s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:51 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5 Jul 06 12:18:51 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:51 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f" returned: 1 in 1.100s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:18:51 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Downloaded image f0c13c75-9e53-4023-8dd2-594f2b18a0f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'metadata': {}}])) to volume 31fec149-2f72-4efc-b0f5-e9d686d5551f successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:18:51 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Temporary image f0c13c75-9e53-4023-8dd2-594f2b18a0f8 for user bf434a8e7bad46ad80e8e7babcefe918 is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:18:51 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Marking volume 31fec149-2f72-4efc-b0f5-e9d686d5551f as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:18:51 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Copying metadata from image f0c13c75-9e53-4023-8dd2-594f2b18a0f8 to 31fec149-2f72-4efc-b0f5-e9d686d5551f. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:18:51 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Creating volume glance metadata for volume 31fec149-2f72-4efc-b0f5-e9d686d5551f backed by image f0c13c75-9e53-4023-8dd2-594f2b18a0f8 with: {'image_id': 'f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'image_name': 'tempest-scenario-img--392357886', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c85497e-cd97-432a-a4c4-f0beb672df4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31fec149-2f72-4efc-b0f5-e9d686d5551f', 'volume_size': 1, 'image_id': 'f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--392357886', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '453bebb35d094ad59e359bcfed72d64f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f0c13c75-9e53-4023-8dd2-594f2b18a0f8', 'created_at': datetime.datetime(2026, 7, 6, 10, 18, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 18, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0c13c75-9e53-4023-8dd2-594f2b18a0f8/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c09e0d-662d-4b6c-b953-f58de491066c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Volume volume-31fec149-2f72-4efc-b0f5-e9d686d5551f (31fec149-2f72-4efc-b0f5-e9d686d5551f): created successfully Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c09e0d-662d-4b6c-b953-f58de491066c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Flow 'volume_create_manager' (c2d8460e-43ee-4537-9409-2aefced4fe9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4bb0b7cc-12a3-4041-a6e8-116082cab9a7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Created volume successfully. Jul 06 12:18:52 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5" returned: 0 in 0.854s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-quobyte-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5" released by "delete_volume" :: held 2.284s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Created reservations ['07ee4475-a79b-45f8-9643-9c59c156947e', '8ee7c2e8-ca19-4d0c-a0e5-cd5fecd69b3f', 'f1e84456-fad4-4eb4-bc7e-5abf608406a4', '9b7653bb-5f25-4ae5-b2b0-f141bb516ba8'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:52 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:18:52 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "cinder-4c1a6f71-8c71-4975-b771-7242dc53b51e-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-4c1a6f71-8c71-4975-b771-7242dc53b51e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:53 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.009s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:53 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Deleted volume successfully. Jul 06 12:18:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a03b6c0b-f269-4cfa-8f32-025c9dc8c48f tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-ff0fd698-1821-4dcc-99ee-eb0d5ca6afb5-delete_volume" released by "delete_volume" :: held 3.679s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "cinder-quobyte-4c1a6f71-8c71-4975-b771-7242dc53b51e" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-quobyte-4c1a6f71-8c71-4975-b771-7242dc53b51e" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0991cd-111b-497c-9b55-21c536687a4e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:54 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e Jul 06 12:18:54 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:55 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e" returned: 0 in 1.160s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:55 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e Jul 06 12:18:55 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:56 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c1a6f71-8c71-4975-b771-7242dc53b51e" returned: 0 in 0.953s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-quobyte-4c1a6f71-8c71-4975-b771-7242dc53b51e" released by "delete_volume" :: held 2.166s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=63,cinder:DELETE=6,cinder:SELECT=75,cinder:INSERT=19 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:18:56 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=61,cinder:UPDATE=66,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:18:56 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Created reservations ['b8a156d0-35a7-4411-9d50-55faec5692d7', 'd831c041-f75c-4236-9024-a8f8c8218102', '0130ffc1-6e9e-4524-9c5c-d23952a639bf', '38ec7fa3-eb74-4626-a5f6-06b3e6064aad'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:56 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:18:56 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:57 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.991s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:18:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Deleted volume successfully. Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1af88caa-275f-4230-81b6-0029c2b456d4 tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-4c1a6f71-8c71-4975-b771-7242dc53b51e-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "cinder-79d8c006-3546-479e-a62e-8b504ebf5256-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-79d8c006-3546-479e-a62e-8b504ebf5256-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "cinder-quobyte-79d8c006-3546-479e-a62e-8b504ebf5256" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-quobyte-79d8c006-3546-479e-a62e-8b504ebf5256" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[676a9a50-47b9-4f3f-8226-4d23506ddb57]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:57 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256 Jul 06 12:18:57 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dcf41f-39fe-4404-8642-8f4703fc647a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:57 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 Jul 06 12:18:57 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:58 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256" returned: 0 in 0.981s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:58 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256 Jul 06 12:18:58 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:58 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741" returned: 0 in 1.112s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed31f33-6a8b-4645-b65d-459890d98db8]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:18:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:59 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 Jul 06 12:18:59 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:59 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79d8c006-3546-479e-a62e-8b504ebf5256" returned: 0 in 0.784s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-quobyte-79d8c006-3546-479e-a62e-8b504ebf5256" released by "delete_volume" :: held 1.834s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Created reservations ['1c0ae89e-d38f-426b-9356-afa8d3fdaa51', '0c88f1ba-650e-43fc-a2c9-776eaafa5cb7', '04df63a6-1053-4e50-9f62-4b2217d1abac', '204cea7e-503a-4501-abf2-c127ed19724f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:18:59 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:18:59 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Flow 'volume_create_manager' (b476443c-92dd-4693-bf74-dfc8776d6e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac67c885-ea54-4c5f-9510-cfb62817100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac67c885-ea54-4c5f-9510-cfb62817100b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1960657368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b995f8eef2f446879c40d7a66f980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:00Z,use_quota=True,user_id='621d123270194814b9ecad7319f0c0c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06984d7-919d-4d11-af13-c386018edf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06984d7-919d-4d11-af13-c386018edf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d42330-6c22-4860-89cd-4d8c2a444580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d42330-6c22-4860-89cd-4d8c2a444580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805', 'volume_name': 'volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb57ed3e-e54b-40f9-a38b-e3347ff43363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb57ed3e-e54b-40f9-a38b-e3347ff43363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0896be67-12db-414e-92f0-ac402a2c26dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:18:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Volume e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805', 'volume_size': 1} Jul 06 12:18:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:00 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741" returned: 0 in 1.037s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.0eea9c12-8b1e-44dc-9aa1-e0f6132549d80ts9usvq.img {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:00 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.0eea9c12-8b1e-44dc-9aa1-e0f6132549d80ts9usvq.img Jul 06 12:19:00 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:00 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.908s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:00 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Deleted volume successfully. Jul 06 12:19:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98d90d6a-2069-4f36-920e-c9885239de47 tempest-AttachVolumeTestJSON-600723819 None] Lock "cinder-79d8c006-3546-479e-a62e-8b504ebf5256-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-01d38293-83f8-447a-8999-fc9fe0d32ec4 req-a4043393-600e-451a-8ed3-522d6a4f130d tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:06 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.0eea9c12-8b1e-44dc-9aa1-e0f6132549d80ts9usvq.img" returned: 0 in 6.454s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b501431e-fec4-4928-9b18-e03b2ed1902d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:06 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 Jul 06 12:19:06 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:07 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741" returned: 0 in 1.219s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:07 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.0eea9c12-8b1e-44dc-9aa1-e0f6132549d80ts9usvq.img {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:19:07 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] Converted 1024.00 MB image at 158.64 MB/s Jul 06 12:19:07 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] 0eea9c12-8b1e-44dc-9aa1-e0f6132549d8 was raw, no need to convert to raw {{(pid=86561) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 06 12:19:12 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:19:17 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=17,cinder:SELECT=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.034s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] Uploaded volume to glance image-id: 0eea9c12-8b1e-44dc-9aa1-e0f6132549d8. {{(pid=86561) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.083s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1960657368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b995f8eef2f446879c40d7a66f980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:19:00Z,use_quota=True,user_id='621d123270194814b9ecad7319f0c0c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Creating volume e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:19:30 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:19:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:30 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 1073741824 Jul 06 12:19:30 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cae14508-0ab7-4e81-8821-b268034497af tempest-VolumesActionsTest-1593358972 None] Copy volume to image completed successfully. Jul 06 12:19:32 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 1073741824" returned: 0 in 1.225s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:32 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 Jul 06 12:19:32 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:32 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:19:32 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:32 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805" returned: 0 in 0.859s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:19:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-01d38293-83f8-447a-8999-fc9fe0d32ec4 req-a4043393-600e-451a-8ed3-522d6a4f130d tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 30.849s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0896be67-12db-414e-92f0-ac402a2c26dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980d4725-da02-490b-9365-301e24897359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0871612d-e60e-4075-b999-42e7c959dc7d]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-01d38293-83f8-447a-8999-fc9fe0d32ec4 req-a4043393-600e-451a-8ed3-522d6a4f130d tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:33 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Volume volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 (e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805): created successfully Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980d4725-da02-490b-9365-301e24897359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Flow 'volume_create_manager' (b476443c-92dd-4693-bf74-dfc8776d6e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:19:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f036d52a-6a21-428e-8aaf-16d32439e7cb tempest-VolumesSnapshotTestJSON-1218911995 None] Created volume successfully. Jul 06 12:19:33 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f Jul 06 12:19:33 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:33 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.776s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:19:33 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-01d38293-83f8-447a-8999-fc9fe0d32ec4 req-a4043393-600e-451a-8ed3-522d6a4f130d tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f" returned: 0 in 0.854s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-01d38293-83f8-447a-8999-fc9fe0d32ec4 req-a4043393-600e-451a-8ed3-522d6a4f130d tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:34 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f Jul 06 12:19:34 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:34 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-01d38293-83f8-447a-8999-fc9fe0d32ec4 req-a4043393-600e-451a-8ed3-522d6a4f130d tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f" returned: 1 in 0.860s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-01d38293-83f8-447a-8999-fc9fe0d32ec4 req-a4043393-600e-451a-8ed3-522d6a4f130d tempest-TestInstancesWithCinderVolumes-1981951198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:19:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-01d38293-83f8-447a-8999-fc9fe0d32ec4 req-a4043393-600e-451a-8ed3-522d6a4f130d tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.775s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.977s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e5d985-28bb-40c8-b002-e9ee87ae9368]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-01d38293-83f8-447a-8999-fc9fe0d32ec4 req-a4043393-600e-451a-8ed3-522d6a4f130d tempest-TestInstancesWithCinderVolumes-1981951198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-31fec149-2f72-4efc-b0f5-e9d686d5551f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cac5132c-2cce-469e-9da8-72f0eb302ae1', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:19:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-01d38293-83f8-447a-8999-fc9fe0d32ec4 req-a4043393-600e-451a-8ed3-522d6a4f130d tempest-TestInstancesWithCinderVolumes-1981951198 None] attachment_update completed successfully. Jul 06 12:19:34 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 Jul 06 12:19:34 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:35 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741" returned: 0 in 0.968s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c49a5a5-8e16-4af7-b7af-564ec12c8171]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:35 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 Jul 06 12:19:35 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:36 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741" returned: 0 in 1.063s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:36 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img Jul 06 12:19:36 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:44 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img" returned: 0 in 7.343s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fc6681-33c9-4cb8-b199-4625dd223d77]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:44 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 Jul 06 12:19:44 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:44 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=7,cinder:INSERT=1,cinder:SELECT=6,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:19:44 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:19:45 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741" returned: 0 in 1.367s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:45 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:19:45 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Converted 1024.00 MB image at 139.42 MB/s Jul 06 12:19:45 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] bd8d156d-cce3-4b16-b959-35dca38c0de9 was raw, converting to qcow2 {{(pid=86561) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 06 12:19:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a41a9a-67ae-456c-8b98-6d3514942579]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:45 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img Jul 06 12:19:45 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:47 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img" returned: 0 in 1.503s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:47 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img Jul 06 12:19:47 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:48 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img" returned: 1 in 1.031s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:19:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img /opt/stack/data/cinder/conversion/vol_upload_8qcrut3k {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:48 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img /opt/stack/data/cinder/conversion/vol_upload_8qcrut3k Jul 06 12:19:48 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:49 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img /opt/stack/data/cinder/conversion/vol_upload_8qcrut3k" returned: 0 in 1.553s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:49 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Image conversion details: src /opt/stack/data/cinder/conversion/5361ca6e-e22a-4d8d-88a1-e27a088b6741.temp_image.bd8d156d-cce3-4b16-b959-35dca38c0de94nbvnjog.img, size 1024.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8qcrut3k {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:19:49 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Converted 1024.00 MB image at 658.67 MB/s Jul 06 12:19:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a476b-f39a-43b7-903e-761686d99e21]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8qcrut3k {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:49 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8qcrut3k Jul 06 12:19:49 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:51 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8qcrut3k" returned: 0 in 1.440s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 20.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Uploaded volume to glance image-id: bd8d156d-cce3-4b16-b959-35dca38c0de9. {{(pid=86561) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 20.459s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] Creating offline snapshot 5989ef87-e691-4dd9-ad52-f9440a5f16ed of volume e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:19:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ccca519c-b4a4-4299-a487-f94708723bc9 tempest-VolumesActionsTest-1593358972 None] Copy volume to image completed successfully. Jul 06 12:19:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[429db9f3-d444-4763-b577-7b938dba3ca5]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:55 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 Jul 06 12:19:55 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:55 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:19:56 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805" returned: 0 in 1.554s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:56 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed 1G Jul 06 12:19:56 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Acquiring lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Acquiring lock "cinder-quobyte-5361ca6e-e22a-4d8d-88a1-e27a088b6741" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:19:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Lock "cinder-quobyte-5361ca6e-e22a-4d8d-88a1-e27a088b6741" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:19:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cff9a43-467c-47b5-99d3-c03742d60d39]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:19:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:57 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 Jul 06 12:19:57 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:58 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed 1G" returned: 0 in 2.109s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:58 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed Jul 06 12:19:58 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:58 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741" returned: 0 in 1.534s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:58 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741 Jul 06 12:19:58 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:59 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5361ca6e-e22a-4d8d-88a1-e27a088b6741" returned: 0 in 1.018s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Lock "cinder-quobyte-5361ca6e-e22a-4d8d-88a1-e27a088b6741" released by "delete_volume" :: held 2.656s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:19:59 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Created reservations ['28878ab8-210e-444c-93c5-4cfb5cdfbc77', '922f679a-50a6-4d4e-8601-08b839d5ada5', '83648ff4-2d2c-4dbe-88c2-172708952593', 'cd266ab6-efd8-4239-918e-f51cc8be2bba'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:19:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:19:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:19:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:19:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:19:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:19:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:59 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:19:59 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:19:59 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 06 12:19:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed" returned: 0 in 1.426s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:19:59 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed is being set with open permissions: ugo+rw Jul 06 12:19:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:19:59 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed Jul 06 12:19:59 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:00 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.907s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:00 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Deleted volume successfully. Jul 06 12:20:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-964bc4fa-79f9-4f2b-8c7b-33b052f26986 tempest-VolumesActionsTest-1593358972 None] Lock "cinder-5361ca6e-e22a-4d8d-88a1-e27a088b6741-delete_volume" released by "delete_volume" :: held 3.932s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:01 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed" returned: 0 in 1.241s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:01 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.info Jul 06 12:20:01 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:02 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.info" returned: 0 in 1.131s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:02 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.info is being set with open permissions: ugo+rw Jul 06 12:20:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:02 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.info Jul 06 12:20:02 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:03 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.info" returned: 0 in 0.721s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.338s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b9887601-4e3b-4cc6-a95d-ddc947cfbf13 tempest-VolumesSnapshotTestJSON-1218911995 None] Create snapshot completed successfully Jul 06 12:20:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-5989ef87-e691-4dd9-ad52-f9440a5f16ed-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-5989ef87-e691-4dd9-ad52-f9440a5f16ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-5989ef87-e691-4dd9-ad52-f9440a5f16ed" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-5989ef87-e691-4dd9-ad52-f9440a5f16ed" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Deleting offline snapshot 5989ef87-e691-4dd9-ad52-f9440a5f16ed of volume e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:20:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] snapshot_file for this snap is: volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:20:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5746852-ecd9-4b85-ad8f-dadd533f60e2]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:04 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed Jul 06 12:20:04 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed" returned: 0 in 0.928s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:20:04 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03762d0-b99c-4d08-8ea8-554a1db5435b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:05 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 Jul 06 12:20:05 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:05 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805" returned: 0 in 0.794s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:05 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed Jul 06 12:20:05 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:06 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed" returned: 0 in 0.925s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:06 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed Jul 06 12:20:06 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:07 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805.5989ef87-e691-4dd9-ad52-f9440a5f16ed" returned: 0 in 0.731s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-5989ef87-e691-4dd9-ad52-f9440a5f16ed" released by "_delete_snapshot" :: held 3.553s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805" released by "delete_snapshot" :: held 3.584s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:07 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Created reservations ['14dca288-215e-47e8-9f7a-ae20b036dcf3', '6a191bac-e535-4c42-931a-79c9c30152ee', '976e0976-7be8-4587-872c-e5b60b9b0e17', 'e05284f8-9fda-4022-b773-6b1398381922'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Delete snapshot completed successfully. Jul 06 12:20:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9b58bfed-43d8-469c-973d-476b08af382c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-5989ef87-e691-4dd9-ad52-f9440a5f16ed-delete_snapshot" released by "delete_snapshot" :: held 3.831s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Flow 'volume_create_manager' (a871cc04-a168-404d-8c0f-c966e8b65410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1906a3b1-0014-49f6-a820-4e083973899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1906a3b1-0014-49f6-a820-4e083973899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2035689343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab443e1-dd63-4e87-9c5f-8de9af588d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b995f8eef2f446879c40d7a66f980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:09Z,use_quota=True,user_id='621d123270194814b9ecad7319f0c0c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d33b62-d287-44f9-9c8c-4035f1e8e4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d33b62-d287-44f9-9c8c-4035f1e8e4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690b3b9d-5b6f-47df-bb39-5989ebcea28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690b3b9d-5b6f-47df-bb39-5989ebcea28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ab443e1-dd63-4e87-9c5f-8de9af588d97', 'volume_name': 'volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640106ce-0ea7-4d6e-b724-8b471a6aa946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640106ce-0ea7-4d6e-b724-8b471a6aa946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89571cd4-78e7-4b55-b08a-b42bd0615b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Volume 6ab443e1-dd63-4e87-9c5f-8de9af588d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97', 'volume_size': 1} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2035689343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ab443e1-dd63-4e87-9c5f-8de9af588d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b995f8eef2f446879c40d7a66f980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:09Z,use_quota=True,user_id='621d123270194814b9ecad7319f0c0c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Creating volume 6ab443e1-dd63-4e87-9c5f-8de9af588d97 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:09 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:09 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 1073741824 Jul 06 12:20:09 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Flow 'volume_create_manager' (3aa2e5de-8882-4584-bcf7-f153d2edce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b893e31-3b8b-4e1d-9954-24d767e30212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b893e31-3b8b-4e1d-9954-24d767e30212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1871034543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab7f34d-2f26-4381-b335-12ac9926c39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ac11232870443992db7a30f1e31797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:10Z,use_quota=True,user_id='b27545d09c5b4f3ba0351d36bf695771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5419941-93dd-4bd4-83a8-8d51865821e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5419941-93dd-4bd4-83a8-8d51865821e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e65a83-9255-47fd-a02b-ed4f4e90c1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e65a83-9255-47fd-a02b-ed4f4e90c1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab7f34d-2f26-4381-b335-12ac9926c39c', 'volume_name': 'volume-eab7f34d-2f26-4381-b335-12ac9926c39c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526ec82e-906b-45ac-8bb9-1af7291b9de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526ec82e-906b-45ac-8bb9-1af7291b9de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29b7e6b-9cd5-4b55-942c-9cc1933f5cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Volume eab7f34d-2f26-4381-b335-12ac9926c39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab7f34d-2f26-4381-b335-12ac9926c39c', 'volume_size': 1} Jul 06 12:20:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:10 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 1073741824" returned: 0 in 1.140s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:10 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 Jul 06 12:20:10 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:10 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97" returned: 0 in 0.787s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.201s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1871034543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab7f34d-2f26-4381-b335-12ac9926c39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ac11232870443992db7a30f1e31797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:10Z,use_quota=True,user_id='b27545d09c5b4f3ba0351d36bf695771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Creating volume eab7f34d-2f26-4381-b335-12ac9926c39c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:11 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:20:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:11 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c 1073741824 Jul 06 12:20:11 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89571cd4-78e7-4b55-b08a-b42bd0615b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8746df02-1d8a-4570-89a9-5a8a15af290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:11 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Volume volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 (6ab443e1-dd63-4e87-9c5f-8de9af588d97): created successfully Jul 06 12:20:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8746df02-1d8a-4570-89a9-5a8a15af290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Flow 'volume_create_manager' (a871cc04-a168-404d-8c0f-c966e8b65410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e88e52e3-b94f-49aa-8f08-c3e607f6cb23 tempest-VolumesSnapshotTestJSON-1218911995 None] Created volume successfully. Jul 06 12:20:12 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c 1073741824" returned: 0 in 1.006s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:12 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c Jul 06 12:20:12 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:12 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c" returned: 0 in 0.780s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.524s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] Creating offline snapshot b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb of volume 6ab443e1-dd63-4e87-9c5f-8de9af588d97 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29b7e6b-9cd5-4b55-942c-9cc1933f5cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab7f34d-2f26-4381-b335-12ac9926c39c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba0b8dc-faf2-4381-a052-62054a17d201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6a1ed3-83d1-480b-9206-cd79c794967f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Volume volume-eab7f34d-2f26-4381-b335-12ac9926c39c (eab7f34d-2f26-4381-b335-12ac9926c39c): created successfully Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba0b8dc-faf2-4381-a052-62054a17d201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Flow 'volume_create_manager' (3aa2e5de-8882-4584-bcf7-f153d2edce1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-dbd4154d-aead-487f-8439-0490a81e562e tempest-VolumesCloneTest-1425864691 None] Created volume successfully. Jul 06 12:20:13 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 Jul 06 12:20:13 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:13 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97" returned: 0 in 0.831s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:13 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb 1G Jul 06 12:20:13 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Flow 'volume_create_manager' (46e583ce-29de-436a-a01c-edb0a52f88b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82283c49-f3cc-4f6a-9ba0-ce6169f97002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82283c49-f3cc-4f6a-9ba0-ce6169f97002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-165791087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa81a50-7218-4156-bcce-68e12067719f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ac11232870443992db7a30f1e31797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=eab7f34d-2f26-4381-b335-12ac9926c39c,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:15Z,use_quota=True,user_id='b27545d09c5b4f3ba0351d36bf695771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebabd78-30c5-4ca8-93be-e11925d8e3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebabd78-30c5-4ca8-93be-e11925d8e3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7ff18d-19ed-48c6-8a9b-dc27daafca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7ff18d-19ed-48c6-8a9b-dc27daafca45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6fa81a50-7218-4156-bcce-68e12067719f', 'volume_name': 'volume-6fa81a50-7218-4156-bcce-68e12067719f', 'volume_size': 2, 'source_volid': 'eab7f34d-2f26-4381-b335-12ac9926c39c', 'source_volstatus': 'available'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b17ba91-83b2-40d3-8742-af844c95eeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b17ba91-83b2-40d3-8742-af844c95eeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99434c0-ada9-498b-9476-79417428c975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:14 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Volume 6fa81a50-7218-4156-bcce-68e12067719f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6fa81a50-7218-4156-bcce-68e12067719f', 'volume_size': 2, 'source_volid': 'eab7f34d-2f26-4381-b335-12ac9926c39c', 'source_volstatus': 'available'} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:14 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb 1G" returned: 0 in 1.097s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:14 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb Jul 06 12:20:14 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Flow 'volume_create_manager' (19041d1f-e7fa-4849-b273-15dd4b7340ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a8a182-94d3-4c55-9a94-cb7f18628124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a8a182-94d3-4c55-9a94-cb7f18628124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-600644855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c93ae87-1d4f-4dc9-8e7d-1464b5c85569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bccd738c6944ce946f9903cae833c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:15Z,use_quota=True,user_id='2cbd8cc0990d4821837dc77bd62fb401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b7d572-6922-44b5-817e-d9654fc81179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b7d572-6922-44b5-817e-d9654fc81179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135d56f3-f2b0-4406-a17e-4e58a975a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135d56f3-f2b0-4406-a17e-4e58a975a79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c93ae87-1d4f-4dc9-8e7d-1464b5c85569', 'volume_name': 'volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1407147e-f69a-4dda-b5b3-d07ba1c1a993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1407147e-f69a-4dda-b5b3-d07ba1c1a993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1d6b69-927e-46c3-8f6b-4f03383e07d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Volume 7c93ae87-1d4f-4dc9-8e7d-1464b5c85569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569', 'volume_size': 1} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-46ea62ac-0a85-416b-b97a-f5914d4af20c req-5bcb6744-69b6-4d87-9d7c-ea4537c2ad45 tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:15 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb" returned: 0 in 0.841s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:15 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb is being set with open permissions: ugo+rw Jul 06 12:20:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:15 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb Jul 06 12:20:15 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:16 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb" returned: 0 in 0.731s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:16 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.info Jul 06 12:20:16 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:17 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.info" returned: 0 in 0.694s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:17 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.info is being set with open permissions: ugo+rw Jul 06 12:20:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:17 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.info Jul 06 12:20:17 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:17 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.info" returned: 0 in 0.754s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.062s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.166s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:17 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Cloning volume eab7f34d-2f26-4381-b335-12ac9926c39c to volume 6fa81a50-7218-4156-bcce-68e12067719f Jul 06 12:20:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f3a12615-c7a5-49c4-9ecd-930eca686069 tempest-VolumesSnapshotTestJSON-1218911995 None] Create snapshot completed successfully Jul 06 12:20:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Creating offline snapshot cac9f67b-13ee-47a3-a40d-b0688fe36547 of volume eab7f34d-2f26-4381-b335-12ac9926c39c {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:20:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aed1d1c-82d7-462b-931a-bc1aa3b6fa94]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:18 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c Jul 06 12:20:18 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:19 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c" returned: 0 in 1.033s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:19 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 1G Jul 06 12:20:19 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Flow 'volume_create_manager' (dea14e7d-8cd9-4d97-9fe2-30a7d26422fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67e397b-34f7-422a-ba68-b305013e70c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67e397b-34f7-422a-ba68-b305013e70c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1299006308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f4eb4c-e337-4eba-9e00-300308ca3c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b995f8eef2f446879c40d7a66f980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:19Z,use_quota=True,user_id='621d123270194814b9ecad7319f0c0c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a76b93-9a9a-4e58-891b-871bbeec8ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a76b93-9a9a-4e58-891b-871bbeec8ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6d07d4-47a6-46a0-b1ae-7839a20c2c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6d07d4-47a6-46a0-b1ae-7839a20c2c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f5f4eb4c-e337-4eba-9e00-300308ca3c27', 'volume_name': 'volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27', 'volume_size': 2, 'snapshot_id': 'b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f981a8e5-6f89-4778-917a-3e3bb4bdf0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f981a8e5-6f89-4778-917a-3e3bb4bdf0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfc50b8-3d19-402d-b67f-e5162b046c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:19 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Volume f5f4eb4c-e337-4eba-9e00-300308ca3c27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27', 'volume_size': 2, 'snapshot_id': 'b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb'} Jul 06 12:20:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:20 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 1G" returned: 0 in 1.234s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab7f34d-2f26-4381-b335-12ac9926c39c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:20 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab7f34d-2f26-4381-b335-12ac9926c39c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 Jul 06 12:20:20 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:21 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab7f34d-2f26-4381-b335-12ac9926c39c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547" returned: 0 in 0.832s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:21 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 is being set with open permissions: ugo+rw Jul 06 12:20:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:21 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 Jul 06 12:20:21 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:21 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547" returned: 0 in 0.722s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:21 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.info Jul 06 12:20:21 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:22 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.info" returned: 0 in 0.676s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:22 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.info is being set with open permissions: ugo+rw Jul 06 12:20:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:22 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.info Jul 06 12:20:22 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:23 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.info" returned: 0 in 0.679s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Acquiring lock "cinder-quobyte-6fa81a50-7218-4156-bcce-68e12067719f" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Lock "cinder-quobyte-6fa81a50-7218-4156-bcce-68e12067719f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] snapshot: cac9f67b-13ee-47a3-a40d-b0688fe36547, volume: 6fa81a50-7218-4156-bcce-68e12067719f, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:20:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc50cae-6c20-43ac-afa1-acca0b0d5e36]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:23 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 Jul 06 12:20:23 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:24 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547" returned: 0 in 0.787s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab7f34d-2f26-4381-b335-12ac9926c39c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:20:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:20:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:20:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd1cd22-dcdb-49b5-a5c0-11ca7618caeb]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:24 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c Jul 06 12:20:24 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:24 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c" returned: 0 in 0.837s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:24 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:20:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:24 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f Jul 06 12:20:24 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:29 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f" returned: 0 in 4.918s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6067b42-9c47-4f43-9d5c-041b7783c582]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:29 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c Jul 06 12:20:29 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:30 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c" returned: 0 in 0.976s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:30 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:20:30 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Converted 1024.00 MB image at 208.14 MB/s Jul 06 12:20:30 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f is being set with open permissions: ugo+rw Jul 06 12:20:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:30 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f Jul 06 12:20:30 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:31 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f" returned: 0 in 0.744s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Lock "cinder-quobyte-6fa81a50-7218-4156-bcce-68e12067719f" released by "_copy_volume_from_snapshot" :: held 8.354s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Acquiring lock "cinder-quobyte-cac9f67b-13ee-47a3-a40d-b0688fe36547" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Lock "cinder-quobyte-cac9f67b-13ee-47a3-a40d-b0688fe36547" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Deleting offline snapshot cac9f67b-13ee-47a3-a40d-b0688fe36547 of volume eab7f34d-2f26-4381-b335-12ac9926c39c {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:20:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] snapshot_file for this snap is: volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:20:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a79ebc3-7525-4402-8275-63e74b9a9d94]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:31 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 Jul 06 12:20:31 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:31 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=33,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:20:32 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547" returned: 0 in 0.878s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab7f34d-2f26-4381-b335-12ac9926c39c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:20:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[06da9a87-e105-4fe7-ac71-887860459e98]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:32 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c Jul 06 12:20:32 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:20:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:32 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:20:32 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:33 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c" returned: 0 in 0.812s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:33 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 Jul 06 12:20:33 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:33 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.770s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:20:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:20:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:20:34 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547" returned: 0 in 0.750s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:34 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547 Jul 06 12:20:34 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:34 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c.cac9f67b-13ee-47a3-a40d-b0688fe36547" returned: 0 in 0.689s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Lock "cinder-quobyte-cac9f67b-13ee-47a3-a40d-b0688fe36547" released by "_delete_snapshot" :: held 3.234s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.991s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.629s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-600644855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c93ae87-1d4f-4dc9-8e7d-1464b5c85569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bccd738c6944ce946f9903cae833c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:15Z,use_quota=True,user_id='2cbd8cc0990d4821837dc77bd62fb401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Creating volume 7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:34 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99434c0-ada9-498b-9476-79417428c975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa81a50-7218-4156-bcce-68e12067719f', 'volume_size': 2, 'source_volid': 'eab7f34d-2f26-4381-b335-12ac9926c39c', 'source_volstatus': 'available'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:34 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 1073741824 Jul 06 12:20:34 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85533f1-2303-45c4-9ea2-f9f9feeee809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Volume volume-6fa81a50-7218-4156-bcce-68e12067719f (6fa81a50-7218-4156-bcce-68e12067719f): created successfully Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85533f1-2303-45c4-9ea2-f9f9feeee809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Flow 'volume_create_manager' (46e583ce-29de-436a-a01c-edb0a52f88b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-babb5856-d707-454f-a489-e32325a59f8c tempest-VolumesCloneTest-1425864691 None] Created volume successfully. Jul 06 12:20:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Acquiring lock "cinder-6fa81a50-7218-4156-bcce-68e12067719f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Lock "cinder-6fa81a50-7218-4156-bcce-68e12067719f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Acquiring lock "cinder-quobyte-6fa81a50-7218-4156-bcce-68e12067719f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Lock "cinder-quobyte-6fa81a50-7218-4156-bcce-68e12067719f" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:35 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 1073741824" returned: 0 in 0.981s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce3433d-06da-48b8-a3a7-c0a3417c8bbb]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:36 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 Jul 06 12:20:36 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:36 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f Jul 06 12:20:36 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:36 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569" returned: 0 in 0.758s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-46ea62ac-0a85-416b-b97a-f5914d4af20c req-5bcb6744-69b6-4d87-9d7c-ea4537c2ad45 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.452s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1d6b69-927e-46c3-8f6b-4f03383e07d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2d7abb-de40-410d-847a-1bd5be60d6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5581aa9c-6e57-4f2f-a9ee-bddb1d2d3b6e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-46ea62ac-0a85-416b-b97a-f5914d4af20c req-5bcb6744-69b6-4d87-9d7c-ea4537c2ad45 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:36 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Volume volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 (7c93ae87-1d4f-4dc9-8e7d-1464b5c85569): created successfully Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2d7abb-de40-410d-847a-1bd5be60d6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Flow 'volume_create_manager' (19041d1f-e7fa-4849-b273-15dd4b7340ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-086e61ed-8649-4826-991e-c54c7c774228 tempest-AttachVolumeNegativeTest-428349029 None] Created volume successfully. Jul 06 12:20:36 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 Jul 06 12:20:36 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:36 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f" returned: 0 in 1.011s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:36 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f Jul 06 12:20:36 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:37 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fa81a50-7218-4156-bcce-68e12067719f" returned: 0 in 0.767s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Lock "cinder-quobyte-6fa81a50-7218-4156-bcce-68e12067719f" released by "delete_volume" :: held 1.850s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:37 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-46ea62ac-0a85-416b-b97a-f5914d4af20c req-5bcb6744-69b6-4d87-9d7c-ea4537c2ad45 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3" returned: 0 in 0.973s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-46ea62ac-0a85-416b-b97a-f5914d4af20c req-5bcb6744-69b6-4d87-9d7c-ea4537c2ad45 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 18.145s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb-f5f4eb4c-e337-4eba-9e00-300308ca3c27" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb-f5f4eb4c-e337-4eba-9e00-300308ca3c27" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Creating volume f5f4eb4c-e337-4eba-9e00-300308ca3c27 from snapshot b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-f5f4eb4c-e337-4eba-9e00-300308ca3c27" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-f5f4eb4c-e337-4eba-9e00-300308ca3c27" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] snapshot: b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb, volume: f5f4eb4c-e337-4eba-9e00-300308ca3c27, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-46ea62ac-0a85-416b-b97a-f5914d4af20c req-5bcb6744-69b6-4d87-9d7c-ea4537c2ad45 tempest-TestInstancesWithCinderVolumes-1981951198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f197a6a7-f07c-466d-8f3a-857ca7776e62', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Created reservations ['04b2fa6b-dcab-4863-ab7c-6164a267cf6b', '3888251b-b5d0-45f8-b842-0bb4b06ada90', '826f63f4-db05-4355-9fd4-14ed95da06f0', '0a9e4234-3939-4cdc-8271-1a6fa9cd8fa2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[543cb2bc-14a9-4d69-bf45-52efba21e0e4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-46ea62ac-0a85-416b-b97a-f5914d4af20c req-5bcb6744-69b6-4d87-9d7c-ea4537c2ad45 tempest-TestInstancesWithCinderVolumes-1981951198 None] attachment_update completed successfully. Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:38 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb Jul 06 12:20:38 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:38 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:20:38 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Acquiring lock "cinder-eab7f34d-2f26-4381-b335-12ac9926c39c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Lock "cinder-eab7f34d-2f26-4381-b335-12ac9926c39c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Acquiring lock "cinder-quobyte-eab7f34d-2f26-4381-b335-12ac9926c39c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Lock "cinder-quobyte-eab7f34d-2f26-4381-b335-12ac9926c39c" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c167e2f2-f5c2-4658-bf76-cb18a02d53fb]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:38 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c Jul 06 12:20:38 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:38 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.860s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Deleted volume successfully. Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26098164-3826-4aa6-9d76-aa9d6dc63ef8 tempest-VolumesCloneTest-1425864691 None] Lock "cinder-6fa81a50-7218-4156-bcce-68e12067719f-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:38 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb" returned: 0 in 1.030s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:20:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:20:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:20:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a4de7-629a-40ed-a75e-838a5131d0db]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:39 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 Jul 06 12:20:39 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:39 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c" returned: 0 in 1.039s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:39 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c Jul 06 12:20:39 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:40 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97" returned: 0 in 1.137s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:40 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 Jul 06 12:20:40 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:40 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eab7f34d-2f26-4381-b335-12ac9926c39c" returned: 0 in 0.803s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Lock "cinder-quobyte-eab7f34d-2f26-4381-b335-12ac9926c39c" released by "delete_volume" :: held 1.928s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Created reservations ['31493a47-3d49-46c5-9156-f6f804ba06bd', '460d2fa9-410a-4838-bd66-71433142b714', 'e90d80f9-4aad-4327-9017-e3af87cb7428', 'bc35a311-bdb5-4134-b0db-6f3fa6d743cd'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-18b29366-fa8f-4321-9bea-6c68d31e920f req-45bf00aa-2640-4000-ac29-42380bfd5d67 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:40 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:20:40 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:42 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.670s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:42 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Deleted volume successfully. Jul 06 12:20:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9842443a-35c7-4462-abe9-d5e0b19459eb tempest-VolumesCloneTest-1425864691 None] Lock "cinder-eab7f34d-2f26-4381-b335-12ac9926c39c-delete_volume" released by "delete_volume" :: held 4.008s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:46 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27" returned: 0 in 6.421s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:46 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7ec019-ca8f-4735-a456-8588b95e6243]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:46 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 Jul 06 12:20:46 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Flow 'volume_create_manager' (d8108e80-251a-418f-a2c8-c5d8aac95dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a4b736-4398-4598-b597-0ff16f0c3320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a4b736-4398-4598-b597-0ff16f0c3320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-910666859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34137128-4c04-4c93-a870-0b352b7869ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6acd895be7d54bf39be8ce12e53fa29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:48Z,use_quota=True,user_id='b343e857641f45a690083a88d135ac14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29742f51-ac01-4543-ade9-954f38bb0e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29742f51-ac01-4543-ade9-954f38bb0e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d0225d-f288-48cd-928a-8f4a88326a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d0225d-f288-48cd-928a-8f4a88326a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34137128-4c04-4c93-a870-0b352b7869ef', 'volume_name': 'volume-34137128-4c04-4c93-a870-0b352b7869ef', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda99e70-ae65-430c-b93d-44631e971b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda99e70-ae65-430c-b93d-44631e971b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f80ff87-0532-44c8-8707-994945a2de19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:47 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Volume 34137128-4c04-4c93-a870-0b352b7869ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34137128-4c04-4c93-a870-0b352b7869ef', 'volume_size': 1} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:47 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97" returned: 0 in 1.204s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:20:47 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Converted 1024.00 MB image at 159.46 MB/s Jul 06 12:20:47 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 is being set with open permissions: ugo+rw Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:47 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 Jul 06 12:20:47 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-c9c6a15a-4104-4fc9-8e95-cc95d6929db3 req-43229ce4-b737-4816-8509-9fa0fc564426 tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:48 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27" returned: 0 in 0.734s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-f5f4eb4c-e337-4eba-9e00-300308ca3c27" released by "_copy_volume_from_snapshot" :: held 10.761s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb-f5f4eb4c-e337-4eba-9e00-300308ca3c27" released by "_create_volume_from_snapshot" :: held 10.797s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.821s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-18b29366-fa8f-4321-9bea-6c68d31e920f req-45bf00aa-2640-4000-ac29-42380bfd5d67 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.070s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:48 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e800fb-8a4f-4588-ab0b-e29b56fbd765]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-18b29366-fa8f-4321-9bea-6c68d31e920f req-45bf00aa-2640-4000-ac29-42380bfd5d67 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfc50b8-3d19-402d-b67f-e5162b046c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27', 'volume_size': 2, 'snapshot_id': 'b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c22345-63db-4ff2-8d78-4dcf08a68dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:48 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Volume volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 (f5f4eb4c-e337-4eba-9e00-300308ca3c27): created successfully Jul 06 12:20:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c22345-63db-4ff2-8d78-4dcf08a68dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Flow 'volume_create_manager' (dea14e7d-8cd9-4d97-9fe2-30a7d26422fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:48 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a08959e5-3cd0-460a-ac3b-f762230754db tempest-VolumesSnapshotTestJSON-1218911995 None] Created volume successfully. Jul 06 12:20:48 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 Jul 06 12:20:48 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:49 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-18b29366-fa8f-4321-9bea-6c68d31e920f req-45bf00aa-2640-4000-ac29-42380bfd5d67 tempest-AttachVolumeNegativeTest-428349029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569" returned: 0 in 0.835s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-18b29366-fa8f-4321-9bea-6c68d31e920f req-45bf00aa-2640-4000-ac29-42380bfd5d67 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.860s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.710s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-910666859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34137128-4c04-4c93-a870-0b352b7869ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6acd895be7d54bf39be8ce12e53fa29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:20:48Z,use_quota=True,user_id='b343e857641f45a690083a88d135ac14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Creating volume 34137128-4c04-4c93-a870-0b352b7869ef {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:20:49 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:49 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef 1073741824 Jul 06 12:20:49 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-18b29366-fa8f-4321-9bea-6c68d31e920f req-45bf00aa-2640-4000-ac29-42380bfd5d67 tempest-AttachVolumeNegativeTest-428349029 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90884301-9bed-4e7c-94bb-f484e6b73c5e', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:20:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-18b29366-fa8f-4321-9bea-6c68d31e920f req-45bf00aa-2640-4000-ac29-42380bfd5d67 tempest-AttachVolumeNegativeTest-428349029 None] attachment_update completed successfully. Jul 06 12:20:50 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-f5f4eb4c-e337-4eba-9e00-300308ca3c27-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef 1073741824" returned: 0 in 1.015s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-f5f4eb4c-e337-4eba-9e00-300308ca3c27-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-f5f4eb4c-e337-4eba-9e00-300308ca3c27" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:50 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef Jul 06 12:20:50 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-f5f4eb4c-e337-4eba-9e00-300308ca3c27" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:50 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb5a70a-32be-459b-afd7-789e2d46a87d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:50 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 Jul 06 12:20:50 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:51 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27" returned: 0 in 0.862s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:51 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27 Jul 06 12:20:51 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:51 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef" returned: 0 in 1.009s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-c9c6a15a-4104-4fc9-8e95-cc95d6929db3 req-43229ce4-b737-4816-8509-9fa0fc564426 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.683s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f80ff87-0532-44c8-8707-994945a2de19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34137128-4c04-4c93-a870-0b352b7869ef', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a163d91-3b35-4368-82f8-b767c44f3918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bf3434-cfa7-46cc-8081-ff2701d8ce6d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-c9c6a15a-4104-4fc9-8e95-cc95d6929db3 req-43229ce4-b737-4816-8509-9fa0fc564426 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:51 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Volume volume-34137128-4c04-4c93-a870-0b352b7869ef (34137128-4c04-4c93-a870-0b352b7869ef): created successfully Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a163d91-3b35-4368-82f8-b767c44f3918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:20:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Flow 'volume_create_manager' (d8108e80-251a-418f-a2c8-c5d8aac95dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:20:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-48cf7e27-e704-4800-92e7-55174df98f0e tempest-VolumesNegativeTest-810905928 None] Created volume successfully. Jul 06 12:20:51 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68 Jul 06 12:20:51 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:52 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5f4eb4c-e337-4eba-9e00-300308ca3c27" returned: 0 in 0.752s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-f5f4eb4c-e337-4eba-9e00-300308ca3c27" released by "delete_volume" :: held 1.685s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Created reservations ['af1b82f9-a775-4a3b-9cc7-96172fbf468d', '785442b1-5037-459c-aeba-7c644d4ca25d', '2cbd4462-755a-4fd4-b37b-dd373541addb', '0c9aa28d-1ff5-49d3-a66e-78293ada33b0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:52 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:20:52 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:52 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-c9c6a15a-4104-4fc9-8e95-cc95d6929db3 req-43229ce4-b737-4816-8509-9fa0fc564426 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68" returned: 0 in 0.955s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-c9c6a15a-4104-4fc9-8e95-cc95d6929db3 req-43229ce4-b737-4816-8509-9fa0fc564426 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.998s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-c9c6a15a-4104-4fc9-8e95-cc95d6929db3 req-43229ce4-b737-4816-8509-9fa0fc564426 tempest-TestInstancesWithCinderVolumes-1981951198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-456e6080-e1a5-4d88-9910-5151a28dbf68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed034be4-ed41-47eb-8620-c41bff46354e', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:20:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-c9c6a15a-4104-4fc9-8e95-cc95d6929db3 req-43229ce4-b737-4816-8509-9fa0fc564426 tempest-TestInstancesWithCinderVolumes-1981951198 None] attachment_update completed successfully. Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-6ab443e1-dd63-4e87-9c5f-8de9af588d97" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-6ab443e1-dd63-4e87-9c5f-8de9af588d97" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Deleting offline snapshot b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb of volume 6ab443e1-dd63-4e87-9c5f-8de9af588d97 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:20:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] snapshot_file for this snap is: volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:20:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4a205c-97dc-4352-bb05-edd92ed75377]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:53 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb Jul 06 12:20:53 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:53 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.916s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:53 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:20:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Deleted volume successfully. Jul 06 12:20:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-25a08a84-459c-4ff1-8e67-480822c3ff11 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-f5f4eb4c-e337-4eba-9e00-300308ca3c27-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:54 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb" returned: 0 in 1.246s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:20:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cffd748-2483-4fe5-904c-d5949e631eb7]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:54 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 Jul 06 12:20:54 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:55 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97" returned: 0 in 1.118s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:55 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb Jul 06 12:20:55 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:56 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb" returned: 0 in 0.846s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:56 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb Jul 06 12:20:56 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:57 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97.b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb" returned: 0 in 0.898s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:57 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=76,cinder:INSERT=13,cinder:UPDATE=64,cinder:DELETE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb" released by "_delete_snapshot" :: held 4.255s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-6ab443e1-dd63-4e87-9c5f-8de9af588d97" released by "delete_snapshot" :: held 4.291s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Created reservations ['6dc5b732-92f7-46e4-9fb9-c3a51de60693', 'da37b323-9982-4dcb-8905-7e1772400d58', '5c95c8f5-9c02-44fb-b5c1-d34d2d90f5a4', 'aa8c12d5-1360-499f-988c-649882e520a3'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:20:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Delete snapshot completed successfully. Jul 06 12:20:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-070ba2d0-454d-4975-b783-8cfc03d2dad9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-b9ad72cd-05d4-4dcf-a8dc-2b239e4259eb-delete_snapshot" released by "delete_snapshot" :: held 4.472s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:20:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-6ab443e1-dd63-4e87-9c5f-8de9af588d97-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-6ab443e1-dd63-4e87-9c5f-8de9af588d97-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-6ab443e1-dd63-4e87-9c5f-8de9af588d97" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:20:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-6ab443e1-dd63-4e87-9c5f-8de9af588d97" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:20:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dc194a-6e4e-48a9-945c-e946c10c04ee]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:20:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:58 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 Jul 06 12:20:58 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:20:59 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 06 12:20:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97" returned: 0 in 1.199s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:20:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:20:59 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97 Jul 06 12:20:59 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:00 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6ab443e1-dd63-4e87-9c5f-8de9af588d97" returned: 0 in 0.997s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-6ab443e1-dd63-4e87-9c5f-8de9af588d97" released by "delete_volume" :: held 2.284s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:00 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Created reservations ['ba64e4bb-3de9-4ff3-8f1b-71f776c394be', '24fbcb53-33b2-45f6-b038-0966656c43c5', '2c3b7c42-5b0c-434e-b99d-c93d3b15ab2c', '54d6e073-df49-4ffe-8eb6-cf87fa0c0dd2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:01 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:21:01 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:01 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.865s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:01 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Deleted volume successfully. Jul 06 12:21:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9e891a05-29ef-417e-b30a-88a87550af20 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-6ab443e1-dd63-4e87-9c5f-8de9af588d97-delete_volume" released by "delete_volume" :: held 3.494s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Flow 'volume_create_manager' (6618b6b1-b4f2-4c95-8ae2-1bd3581fefb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15eb92ff-85e5-4aec-aa16-1922c83edff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15eb92ff-85e5-4aec-aa16-1922c83edff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-491319130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf2496b-42e9-4eb5-9476-202b2da4f0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b995f8eef2f446879c40d7a66f980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:03Z,use_quota=True,user_id='621d123270194814b9ecad7319f0c0c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7238931-b54d-4400-b75b-7ef89615efc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7238931-b54d-4400-b75b-7ef89615efc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d101280-d93c-4efe-848c-461de4b0fa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d101280-d93c-4efe-848c-461de4b0fa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf2496b-42e9-4eb5-9476-202b2da4f0fe', 'volume_name': 'volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24124b28-a9b1-43e8-a80b-432860792665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24124b28-a9b1-43e8-a80b-432860792665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e370a8f3-740d-4f55-b61b-493376646cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Volume 4cf2496b-42e9-4eb5-9476-202b2da4f0fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe', 'volume_size': 1} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-491319130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf2496b-42e9-4eb5-9476-202b2da4f0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b995f8eef2f446879c40d7a66f980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:03Z,use_quota=True,user_id='621d123270194814b9ecad7319f0c0c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Creating volume 4cf2496b-42e9-4eb5-9476-202b2da4f0fe {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:02 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:02 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe 1073741824 Jul 06 12:21:02 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-03585d5d-3e0f-426a-a942-2b039b4442d9 req-950ce2d9-2af2-4df4-b48c-e460c8d977b1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Terminate volume connection completed successfully. Jul 06 12:21:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-03585d5d-3e0f-426a-a942-2b039b4442d9 req-950ce2d9-2af2-4df4-b48c-e460c8d977b1 tempest-TestInstancesWithCinderVolumes-1981951198 None] Deleting attachment f197a6a7-f07c-466d-8f3a-857ca7776e62. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:21:03 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe 1073741824" returned: 0 in 1.062s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:03 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe Jul 06 12:21:03 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:04 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" returned: 0 in 0.994s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:21:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e370a8f3-740d-4f55-b61b-493376646cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912ee4c6-c97d-4091-bb68-47591c1c594a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:04 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Volume volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe (4cf2496b-42e9-4eb5-9476-202b2da4f0fe): created successfully Jul 06 12:21:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912ee4c6-c97d-4091-bb68-47591c1c594a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Flow 'volume_create_manager' (6618b6b1-b4f2-4c95-8ae2-1bd3581fefb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a5028275-115d-44c0-a97d-eef4ddf14b8a tempest-VolumesSnapshotTestJSON-1218911995 None] Created volume successfully. Jul 06 12:21:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "cinder-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "cinder-quobyte-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-quobyte-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1548d1ac-9e24-4b4c-a38c-045c51c72cf2]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:05 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 Jul 06 12:21:05 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] Creating offline snapshot a4cad908-9ac8-4b41-9a48-3909aeb6c772 of volume 4cf2496b-42e9-4eb5-9476-202b2da4f0fe {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:21:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe3cef4-4656-4bba-9b68-199773adadec]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:06 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3" returned: 0 in 1.597s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:06 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3 Jul 06 12:21:06 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:06 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe Jul 06 12:21:06 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:07 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3" returned: 0 in 1.127s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-quobyte-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3" released by "delete_volume" :: held 2.795s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:07 devstack cinder-volume[86561]: WARNING cinder.quota [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-90732736-949505282 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-90732736-949505282, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:21:07 devstack cinder-volume[86561]: WARNING cinder.quota [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-90732736-949505282 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-90732736-949505282, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:21:07 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Created reservations ['a3f79258-f254-403a-ae31-38d6e0128e74', '334be566-d95d-473c-95fa-4f0d545a18ff', 'd2abcf98-73f0-45d9-9904-0ef54029c506', 'ed3e561d-345d-4754-8e63-72dc7acaa737'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:08 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" returned: 0 in 1.561s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:08 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:21:08 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:08 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 1G Jul 06 12:21:08 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:09 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.446s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:09 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Deleted volume successfully. Jul 06 12:21:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-26f0ebbd-2da5-4aa3-88b7-ccca38a55c68 tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-c5ab622d-ecdb-4c42-a92e-1cf40af3f4d3-delete_volume" released by "delete_volume" :: held 4.641s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:10 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 1G" returned: 0 in 2.012s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:10 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 Jul 06 12:21:10 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:11 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772" returned: 0 in 1.841s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:11 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 is being set with open permissions: ugo+rw Jul 06 12:21:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:12 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 Jul 06 12:21:12 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-8bdf57b5-81d7-4963-9d87-01ef930e6b1b req-c29640aa-ff76-48d9-a1b0-7d9e1a154cb7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Terminate volume connection completed successfully. Jul 06 12:21:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-8bdf57b5-81d7-4963-9d87-01ef930e6b1b req-c29640aa-ff76-48d9-a1b0-7d9e1a154cb7 tempest-TestInstancesWithCinderVolumes-1981951198 None] Deleting attachment ed034be4-ed41-47eb-8620-c41bff46354e. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:21:13 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772" returned: 0 in 1.346s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:13 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.info Jul 06 12:21:13 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:14 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.info" returned: 0 in 0.948s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:14 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.info is being set with open permissions: ugo+rw Jul 06 12:21:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:14 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.info Jul 06 12:21:14 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "cinder-456e6080-e1a5-4d88-9910-5151a28dbf68-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-456e6080-e1a5-4d88-9910-5151a28dbf68-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "cinder-quobyte-456e6080-e1a5-4d88-9910-5151a28dbf68" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-quobyte-456e6080-e1a5-4d88-9910-5151a28dbf68" acquired by "delete_volume" :: waited 0.045s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3739e320-dfba-43a5-be30-8d921ab837ae]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:15 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68 Jul 06 12:21:15 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:15 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.info" returned: 0 in 1.388s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.279s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e0548545-da0a-4720-913d-9f597d0e5c62 tempest-VolumesSnapshotTestJSON-1218911995 None] Create snapshot completed successfully Jul 06 12:21:17 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68" returned: 0 in 1.689s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:17 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68 Jul 06 12:21:17 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:17 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Flow 'volume_create_manager' (0aa47d27-6d5b-49e2-bf9c-14768113973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97cd491f-7d97-4b8c-ad07-360fffba1c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97cd491f-7d97-4b8c-ad07-360fffba1c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2010793084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1931a25a-fb6f-46b6-a6c6-dd560d4c3d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b995f8eef2f446879c40d7a66f980c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4cad908-9ac8-4b41-9a48-3909aeb6c772,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:18Z,use_quota=True,user_id='621d123270194814b9ecad7319f0c0c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4797b50a-25ab-45d7-9374-92b49787442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4797b50a-25ab-45d7-9374-92b49787442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8c4604-e750-4e78-9c7a-9ad1093db2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8c4604-e750-4e78-9c7a-9ad1093db2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1931a25a-fb6f-46b6-a6c6-dd560d4c3d09', 'volume_name': 'volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09', 'volume_size': 1, 'snapshot_id': 'a4cad908-9ac8-4b41-9a48-3909aeb6c772'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058129ed-8e2a-4e8b-a1ef-9b775f723145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058129ed-8e2a-4e8b-a1ef-9b775f723145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0eb34ef-c0ed-4acd-bb12-bea8f9bdf841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Volume 1931a25a-fb6f-46b6-a6c6-dd560d4c3d09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09', 'volume_size': 1, 'snapshot_id': 'a4cad908-9ac8-4b41-9a48-3909aeb6c772'} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-a4cad908-9ac8-4b41-9a48-3909aeb6c772-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-a4cad908-9ac8-4b41-9a48-3909aeb6c772-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Creating volume 1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 from snapshot a4cad908-9ac8-4b41-9a48-3909aeb6c772 {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] snapshot: a4cad908-9ac8-4b41-9a48-3909aeb6c772, volume: 1931a25a-fb6f-46b6-a6c6-dd560d4c3d09, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39069a9-47ae-406e-881a-69f58947a63b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:18 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-456e6080-e1a5-4d88-9910-5151a28dbf68" returned: 0 in 1.405s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-quobyte-456e6080-e1a5-4d88-9910-5151a28dbf68" released by "delete_volume" :: held 3.210s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:18 devstack cinder-volume[86561]: WARNING cinder.quota [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156480926-1971552018 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156480926-1971552018, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:21:18 devstack cinder-volume[86561]: WARNING cinder.quota [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156480926-1971552018 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156480926-1971552018, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:21:18 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Created reservations ['9614f878-baaf-41db-9b11-29bef6492699', '3b9fc4ad-97eb-42e3-ad7c-18b4c145b4a2', '04bbb60a-1bc4-43bd-9174-af8b95920b95', 'ad6164e4-1ea2-42f0-8766-e75c2b061eca'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:18 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 Jul 06 12:21:18 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:19 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:21:19 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:20 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772" returned: 0 in 1.638s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:21:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:21:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:21:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd9bb4f-e30c-499c-802e-02ba06aff772]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:20 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe Jul 06 12:21:20 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:20 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.755s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:20 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:20 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Deleted volume successfully. Jul 06 12:21:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e9ec9873-aecc-48f8-a2ad-11897a4e613e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-456e6080-e1a5-4d88-9910-5151a28dbf68-delete_volume" released by "delete_volume" :: held 5.921s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:21 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" returned: 0 in 1.431s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:21 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:21:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:21 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 Jul 06 12:21:21 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:29 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=70,cinder:INSERT=13,cinder:DELETE=10,cinder:SELECT=64 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:21:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-c393345d-c0dc-4f73-a740-e30934e8bcb7 req-b499b1c5-7e73-43f8-ad73-5ff2dd3321bc tempest-TestInstancesWithCinderVolumes-1981951198 None] Terminate volume connection completed successfully. Jul 06 12:21:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-c393345d-c0dc-4f73-a740-e30934e8bcb7 req-b499b1c5-7e73-43f8-ad73-5ff2dd3321bc tempest-TestInstancesWithCinderVolumes-1981951198 None] Deleting attachment cac5132c-2cce-469e-9da8-72f0eb302ae1. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:21:29 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" returned: 0 in 8.196s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6836dba5-310c-4b24-8c71-31f9ade6add2]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:29 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe Jul 06 12:21:29 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:30 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" returned: 0 in 1.083s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:30 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe, size 1024.00 MB, duration 8.20 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:21:30 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Converted 1024.00 MB image at 124.90 MB/s Jul 06 12:21:30 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 is being set with open permissions: ugo+rw Jul 06 12:21:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:30 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 Jul 06 12:21:30 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:31 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" returned: 0 in 0.712s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" released by "_copy_volume_from_snapshot" :: held 13.262s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-a4cad908-9ac8-4b41-9a48-3909aeb6c772-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" released by "_create_volume_from_snapshot" :: held 13.340s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.394s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0eb34ef-c0ed-4acd-bb12-bea8f9bdf841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09', 'volume_size': 1, 'snapshot_id': 'a4cad908-9ac8-4b41-9a48-3909aeb6c772'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324feabd-c6d9-4d07-a33d-7e9a3a8acbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Volume volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 (1931a25a-fb6f-46b6-a6c6-dd560d4c3d09): created successfully Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324feabd-c6d9-4d07-a33d-7e9a3a8acbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Flow 'volume_create_manager' (0aa47d27-6d5b-49e2-bf9c-14768113973d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b1ca9592-cd54-432b-8ee2-ce7bf562b2b2 tempest-VolumesSnapshotTestJSON-1218911995 None] Created volume successfully. Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4287f6-b130-43b8-89e6-459fa196cec3]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:32 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 Jul 06 12:21:32 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "cinder-31fec149-2f72-4efc-b0f5-e9d686d5551f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-31fec149-2f72-4efc-b0f5-e9d686d5551f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "cinder-quobyte-31fec149-2f72-4efc-b0f5-e9d686d5551f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-quobyte-31fec149-2f72-4efc-b0f5-e9d686d5551f" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[090398fd-96d1-47af-b500-37004640b726]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:32 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:21:32 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:32 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:32 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f Jul 06 12:21:32 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" returned: 0 in 1.015s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:32 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09 Jul 06 12:21:32 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:33 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.756s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:21:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:21:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:21:33 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f" returned: 0 in 0.909s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:33 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" returned: 0 in 0.907s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09" released by "delete_volume" :: held 1.975s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:33 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f Jul 06 12:21:33 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:33 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Created reservations ['5d25e291-67bd-4ba4-ab9d-bcac0956950b', '6b235af7-a724-4634-ae25-0935ccd82fc0', '87e33cd3-276f-4340-97ab-8ea52d120287', 'bea28cd7-0b5b-4974-8a4e-954e148b4bdc'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:34 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:21:34 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-a4cad908-9ac8-4b41-9a48-3909aeb6c772-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-a4cad908-9ac8-4b41-9a48-3909aeb6c772-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-a4cad908-9ac8-4b41-9a48-3909aeb6c772" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-a4cad908-9ac8-4b41-9a48-3909aeb6c772" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Deleting offline snapshot a4cad908-9ac8-4b41-9a48-3909aeb6c772 of volume 4cf2496b-42e9-4eb5-9476-202b2da4f0fe {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] snapshot_file for this snap is: volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c8d1c6-3367-489a-8341-0fb31f950c41]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:34 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 Jul 06 12:21:34 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:34 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f" returned: 1 in 1.086s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:34 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.827s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:34 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f Jul 06 12:21:34 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Deleted volume successfully. Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10ed9b55-e32b-4d57-a4bb-3554c06db7b9 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-1931a25a-fb6f-46b6-a6c6-dd560d4c3d09-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Acquiring lock "cinder-34137128-4c04-4c93-a870-0b352b7869ef-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Lock "cinder-34137128-4c04-4c93-a870-0b352b7869ef-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Acquiring lock "cinder-quobyte-34137128-4c04-4c93-a870-0b352b7869ef" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Lock "cinder-quobyte-34137128-4c04-4c93-a870-0b352b7869ef" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b488896d-ce34-4fa7-991e-730f63ae3b26]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:35 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef Jul 06 12:21:35 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:35 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772" returned: 0 in 1.052s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f920e3c-78c5-448b-8ae5-d13885add02b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:35 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-31fec149-2f72-4efc-b0f5-e9d686d5551f" returned: 0 in 0.747s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-quobyte-31fec149-2f72-4efc-b0f5-e9d686d5551f" released by "delete_volume" :: held 2.811s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:35 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe Jul 06 12:21:35 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:35 devstack cinder-volume[86561]: WARNING cinder.quota [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-181820636-316792828 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-181820636-316792828, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:21:35 devstack cinder-volume[86561]: WARNING cinder.quota [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-181820636-316792828 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-181820636-316792828, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Created reservations ['3c8c622c-fd5f-4501-8b7d-4a6695576de5', 'ddcb34e4-1d35-420f-a4be-028b186fe493', '3530b432-de82-4514-8843-46b2cfd3b3de', 'cffd6c39-cc96-4027-8d44-1b3b0f9fd6ac'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:35 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:21:35 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:36 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef" returned: 0 in 0.933s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:36 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef Jul 06 12:21:36 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:36 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" returned: 0 in 1.011s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:36 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 Jul 06 12:21:36 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:36 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.054s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:36 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Deleted volume successfully. Jul 06 12:21:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6679d722-d80e-401d-a026-1d39b13b2b5e tempest-TestInstancesWithCinderVolumes-1981951198 None] Lock "cinder-31fec149-2f72-4efc-b0f5-e9d686d5551f-delete_volume" released by "delete_volume" :: held 4.192s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:36 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-34137128-4c04-4c93-a870-0b352b7869ef" returned: 0 in 0.910s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Lock "cinder-quobyte-34137128-4c04-4c93-a870-0b352b7869ef" released by "delete_volume" :: held 1.895s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:37 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Created reservations ['fee19307-3005-4d9f-8877-288e158c8846', 'deb6033c-7189-410d-9107-5ed92b45edfb', '2a44fd76-25ce-4b6e-b1e4-def07e790cf9', '60dfb45c-de48-41f3-b604-576de6f65c0a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:37 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:21:37 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:37 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772" returned: 0 in 1.161s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:37 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772 Jul 06 12:21:37 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:38 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.122s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:38 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Deleted volume successfully. Jul 06 12:21:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f8ad73b-c7ff-419f-9f47-5cf20a11cde2 tempest-VolumesNegativeTest-810905928 None] Lock "cinder-34137128-4c04-4c93-a870-0b352b7869ef-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:38 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe.a4cad908-9ac8-4b41-9a48-3909aeb6c772" returned: 0 in 1.084s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-a4cad908-9ac8-4b41-9a48-3909aeb6c772" released by "_delete_snapshot" :: held 4.461s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" released by "delete_snapshot" :: held 4.496s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Created reservations ['badf6e0a-7e59-47e9-9dd5-4496e74a9014', 'cbc3b300-4b91-43b6-8e2a-bce0ba021ba6', '59ac4e79-d9e9-4713-bcf7-932f9ec8c95b', 'e0835a8d-bd17-4545-9e98-1b5a7e6403dc'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Delete snapshot completed successfully. Jul 06 12:21:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d1427418-1086-440a-8026-0c63f4666faf tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-a4cad908-9ac8-4b41-9a48-3909aeb6c772-delete_snapshot" released by "delete_snapshot" :: held 4.729s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-4cf2496b-42e9-4eb5-9476-202b2da4f0fe-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-4cf2496b-42e9-4eb5-9476-202b2da4f0fe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4508fb6-13ff-4c8c-9fcc-cac082ce5b9a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:40 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe Jul 06 12:21:40 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:41 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" returned: 0 in 1.227s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:41 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe Jul 06 12:21:41 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:42 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" returned: 0 in 1.222s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-4cf2496b-42e9-4eb5-9476-202b2da4f0fe" released by "delete_volume" :: held 2.554s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:42 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Created reservations ['b68976d9-face-483a-b4ae-35eb0ad273a1', 'dea3bee9-6319-4d13-ab4c-011e73477128', '7ec54e21-46fd-4b13-95f3-230bfeaeeece', '7b79fc26-ebc8-4b0d-83b0-40ad5671db22'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:42 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:21:42 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "cinder-quobyte-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:21:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:21:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7bdb7a-49df-4667-8a49-e93136e5b9e1]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:43 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 Jul 06 12:21:43 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:43 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.225s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:43 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Deleted volume successfully. Jul 06 12:21:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6e310c1-8af2-4359-a02d-ad1c7724711c tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-4cf2496b-42e9-4eb5-9476-202b2da4f0fe-delete_volume" released by "delete_volume" :: held 4.201s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:44 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805" returned: 0 in 1.218s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:44 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805 Jul 06 12:21:44 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:45 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805" returned: 0 in 0.883s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-quobyte-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805" released by "delete_volume" :: held 2.204s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:45 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Created reservations ['0b09b288-19e9-4181-bb40-1f931084ce96', '24432150-1159-41c6-b4eb-37c5c7c3b96d', '59205549-0a2a-420a-bdcf-03958b6ae94e', '6ed89b7e-ca2e-4e7f-bb90-26d9cc36b752'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:21:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:46 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:21:46 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:46 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.959s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:46 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:21:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Deleted volume successfully. Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0e919372-994e-4602-b303-b8f9abb4d358 tempest-VolumesSnapshotTestJSON-1218911995 None] Lock "cinder-e28e5c7d-fc6e-4b74-8a1e-6402a8bb4805-delete_volume" released by "delete_volume" :: held 3.616s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Flow 'volume_create_manager' (6050106d-6c7e-4213-a1ab-f5ee1948904a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c449c744-e804-4dd8-b7c0-3e02e1bbf094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c449c744-e804-4dd8-b7c0-3e02e1bbf094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c550c6b4-6665-454c-a53b-e8c6be753c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d416fcddec04a6c8ad8a2881eb8b41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:47Z,use_quota=True,user_id='567795ed356c495a89949f6b89f135ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e1336a6-5615-4d24-8007-f2f38698f043),volume_type_id=9e1336a6-5615-4d24-8007-f2f38698f043)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be2b8f0-b51f-4e22-bd0b-2350369a8f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be2b8f0-b51f-4e22-bd0b-2350369a8f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451a9ef2-01f7-43b0-818a-83b89836c1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451a9ef2-01f7-43b0-818a-83b89836c1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c550c6b4-6665-454c-a53b-e8c6be753c2d', 'volume_name': 'volume-c550c6b4-6665-454c-a53b-e8c6be753c2d', 'volume_size': 1, 'image_id': 'a27fd8ea-b4e7-422e-b4f7-564560484a59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a27fd8ea-b4e7-422e-b4f7-564560484a59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1380959c000e122946492ba97fa4970', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d416fcddec04a6c8ad8a2881eb8b41c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f0e881dbad9d12e78af6877f0d99ed8c026fd395cabfb0b025b0718270438df55ffdcd4adb47ccb442fd76e1e571280df95e03c7e11bc73d5f961bc6cfd72ac9', 'id': 'a27fd8ea-b4e7-422e-b4f7-564560484a59', 'created_at': datetime.datetime(2026, 7, 6, 10, 21, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 21, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a27fd8ea-b4e7-422e-b4f7-564560484a59/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01db55a-95e7-4e5a-a8c1-51fc3a30a946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01db55a-95e7-4e5a-a8c1-51fc3a30a946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3539df-14e8-4d7a-8a7b-07bb58f6d21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:47 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Volume c550c6b4-6665-454c-a53b-e8c6be753c2d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c550c6b4-6665-454c-a53b-e8c6be753c2d', 'volume_size': 1, 'image_id': 'a27fd8ea-b4e7-422e-b4f7-564560484a59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a27fd8ea-b4e7-422e-b4f7-564560484a59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1380959c000e122946492ba97fa4970', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d416fcddec04a6c8ad8a2881eb8b41c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f0e881dbad9d12e78af6877f0d99ed8c026fd395cabfb0b025b0718270438df55ffdcd4adb47ccb442fd76e1e571280df95e03c7e11bc73d5f961bc6cfd72ac9', 'id': 'a27fd8ea-b4e7-422e-b4f7-564560484a59', 'created_at': datetime.datetime(2026, 7, 6, 10, 21, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 21, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a27fd8ea-b4e7-422e-b4f7-564560484a59/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Trying to clone c550c6b4-6665-454c-a53b-e8c6be753c2d from image a27fd8ea-b4e7-422e-b4f7-564560484a59 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a27fd8ea-b4e7-422e-b4f7-564560484a59', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:21:47 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0eec96-8c28-4c84-9317-68854f7ed162]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:48 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD Jul 06 12:21:48 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:49 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD" returned: 0 in 1.117s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:49 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD Jul 06 12:21:49 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:50 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD" returned: 1 in 1.154s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:21:50 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Temporary image a27fd8ea-b4e7-422e-b4f7-564560484a59 is fetched for user 567795ed356c495a89949f6b89f135ec. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:21:50 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3626d4f-076e-4c4a-9c2b-666defd484b5]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:50 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD Jul 06 12:21:50 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:51 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD" returned: 0 in 1.176s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:51 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD Jul 06 12:21:51 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:52 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD" returned: 1 in 0.944s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c550c6b4-6665-454c-a53b-e8c6be753c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d416fcddec04a6c8ad8a2881eb8b41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:47Z,use_quota=True,user_id='567795ed356c495a89949f6b89f135ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e1336a6-5615-4d24-8007-f2f38698f043),volume_type_id=9e1336a6-5615-4d24-8007-f2f38698f043)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Creating volume c550c6b4-6665-454c-a53b-e8c6be753c2d {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:52 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:52 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d 1073741824 Jul 06 12:21:52 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-ec96c26f-622c-4606-b5fd-792a696cfbeb req-aeb5de33-07e1-4dbd-8ac8-34a7616ff499 tempest-AttachVolumeNegativeTest-428349029 None] Terminate volume connection completed successfully. Jul 06 12:21:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-ec96c26f-622c-4606-b5fd-792a696cfbeb req-aeb5de33-07e1-4dbd-8ac8-34a7616ff499 tempest-AttachVolumeNegativeTest-428349029 None] Deleting attachment 90884301-9bed-4e7c-94bb-f484e6b73c5e. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:21:53 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d 1073741824" returned: 0 in 1.316s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:53 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d Jul 06 12:21:53 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:54 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d" returned: 0 in 0.769s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:21:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:54 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Attempting download of a27fd8ea-b4e7-422e-b4f7-564560484a59 ((None, [{'url': 'file:///opt/stack/data/glance/images/a27fd8ea-b4e7-422e-b4f7-564560484a59', 'metadata': {}}])) to volume c550c6b4-6665-454c-a53b-e8c6be753c2d. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:21:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd477f60-ab9a-463a-bbdb-2d3e2db9771c]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a27fd8ea-b4e7-422e-b4f7-564560484a59_76n3cfrc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:54 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a27fd8ea-b4e7-422e-b4f7-564560484a59_76n3cfrc Jul 06 12:21:54 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Flow 'volume_create_manager' (b98fc876-4a63-4916-bfa2-de0370b78461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db870d2-ed14-4f9c-9ad3-bec55e914c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db870d2-ed14-4f9c-9ad3-bec55e914c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-500284140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53466786-2fbe-439e-b467-e220d5163e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea5b796ac524bdca8c3087309a2943c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:55Z,use_quota=True,user_id='5a815dfdd201448b9764c73a1565dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346a6b5b-cfaf-45fb-b927-ff8355244f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346a6b5b-cfaf-45fb-b927-ff8355244f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85142d26-76bc-41c7-8f11-f01ca4d4adfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85142d26-76bc-41c7-8f11-f01ca4d4adfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53466786-2fbe-439e-b467-e220d5163e30', 'volume_name': 'volume-53466786-2fbe-439e-b467-e220d5163e30', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7c9a0b-a7b8-463d-98c4-c58fc1a65c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7c9a0b-a7b8-463d-98c4-c58fc1a65c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53bebf7d-8f19-430c-bb36-12a1343de4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Volume 53466786-2fbe-439e-b467-e220d5163e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53466786-2fbe-439e-b467-e220d5163e30', 'volume_size': 1} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-500284140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53466786-2fbe-439e-b467-e220d5163e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea5b796ac524bdca8c3087309a2943c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:55Z,use_quota=True,user_id='5a815dfdd201448b9764c73a1565dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Creating volume 53466786-2fbe-439e-b467-e220d5163e30 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:55 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:55 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30 1073741824 Jul 06 12:21:55 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:55 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Flow 'volume_create_manager' (40678719-b695-441b-b66d-9483a27ee71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f772ab45-5371-49b9-ac94-a599d89beaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f772ab45-5371-49b9-ac94-a599d89beaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070741563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef913daf-1d08-4198-b129-075e8162d937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea5b796ac524bdca8c3087309a2943c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:56Z,use_quota=True,user_id='5a815dfdd201448b9764c73a1565dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9aef339-fef0-48b7-89e7-a34b7c8891f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:56 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9aef339-fef0-48b7-89e7-a34b7c8891f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283a8e1e-8c5f-4312-a38e-36740fa325a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283a8e1e-8c5f-4312-a38e-36740fa325a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef913daf-1d08-4198-b129-075e8162d937', 'volume_name': 'volume-ef913daf-1d08-4198-b129-075e8162d937', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c605f2-854a-4b49-97fa-757650f46240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c605f2-854a-4b49-97fa-757650f46240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15eb6394-ba0c-48a2-adc4-94621e44ae23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Volume ef913daf-1d08-4198-b129-075e8162d937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef913daf-1d08-4198-b129-075e8162d937', 'volume_size': 1} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a27fd8ea-b4e7-422e-b4f7-564560484a59_76n3cfrc" returned: 0 in 1.438s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a27fd8ea-b4e7-422e-b4f7-564560484a59_76n3cfrc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:56 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a27fd8ea-b4e7-422e-b4f7-564560484a59_76n3cfrc Jul 06 12:21:56 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:56 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30 1073741824" returned: 0 in 1.475s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Flow 'volume_create_manager' (b3cc862f-7e7d-4133-a088-98537b28c4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2070b667-967c-4ddf-91d6-166e98ef8283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2070b667-967c-4ddf-91d6-166e98ef8283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1406159616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3719a692-9f62-4d4f-88f8-1f82eacbffdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6dd1031d8e405487deec42ff73358a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:57Z,use_quota=True,user_id='5093be3c113745c8bde965d6fbefa4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395302c7-e579-4140-82f1-4502977bec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395302c7-e579-4140-82f1-4502977bec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf980e9-51c6-4a61-9c43-b1d3efdc40d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf980e9-51c6-4a61-9c43-b1d3efdc40d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3719a692-9f62-4d4f-88f8-1f82eacbffdf', 'volume_name': 'volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae9887b-31be-4b8a-9f8e-a297df7e5ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae9887b-31be-4b8a-9f8e-a297df7e5ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3ac4e6-f60b-4704-8142-bbb33fef9de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Volume 3719a692-9f62-4d4f-88f8-1f82eacbffdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf', 'volume_size': 1} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=70,cinder:INSERT=24,cinder:UPDATE=92,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:57 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30 Jul 06 12:21:57 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Flow 'volume_create_manager' (ead6ce95-1c31-4feb-a2c3-2f27f8feb0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d944ca7-0dba-4d56-bf39-70dac6407b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Flow 'volume_create_manager' (4e7dd097-c687-4273-875d-67eb0a100cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6529becb-f4a3-4ccc-bc9e-21213a76cc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d944ca7-0dba-4d56-bf39-70dac6407b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-305730636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff5d894-ff27-450a-a3c0-ddce6cec4646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea5b796ac524bdca8c3087309a2943c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:57Z,use_quota=True,user_id='5a815dfdd201448b9764c73a1565dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7542339-334b-4eb4-a6fb-55e66c15c065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7542339-334b-4eb4-a6fb-55e66c15c065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3d9f11-20ce-482b-ad40-d93179b4b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3d9f11-20ce-482b-ad40-d93179b4b385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff5d894-ff27-450a-a3c0-ddce6cec4646', 'volume_name': 'volume-dff5d894-ff27-450a-a3c0-ddce6cec4646', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5377d8d2-0a4b-4e04-857a-808c6312031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5377d8d2-0a4b-4e04-857a-808c6312031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfab09b-8e96-4502-a0ff-a931659277fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Volume dff5d894-ff27-450a-a3c0-ddce6cec4646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff5d894-ff27-450a-a3c0-ddce6cec4646', 'volume_size': 1} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6529becb-f4a3-4ccc-bc9e-21213a76cc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809695788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea5b796ac524bdca8c3087309a2943c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:57Z,use_quota=True,user_id='5a815dfdd201448b9764c73a1565dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71381ea3-e529-49c2-a226-7e58b7ab9535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71381ea3-e529-49c2-a226-7e58b7ab9535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455a0061-a00d-456b-92e1-ed5faf1e7e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455a0061-a00d-456b-92e1-ed5faf1e7e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd71cdd1d-fb76-43b5-931a-b49dd8ebd2d1', 'volume_name': 'volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db9ecd6-cb15-4316-93b1-d350784c0241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db9ecd6-cb15-4316-93b1-d350784c0241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc354ee-575b-4ea6-b67b-f875b5f7a01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Volume d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1', 'volume_size': 1} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:57 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a27fd8ea-b4e7-422e-b4f7-564560484a59_76n3cfrc" returned: 1 in 1.687s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a27fd8ea-b4e7-422e-b4f7-564560484a59_76n3cfrc' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7417be9a-6dc5-4a1f-b287-2a0ebbd69e34]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:21:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:58 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD Jul 06 12:21:58 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Flow 'volume_create_manager' (6351b210-cfad-42f0-9b60-476447349fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930f5a76-c090-453f-b4e4-60f84c0c1dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930f5a76-c090-453f-b4e4-60f84c0c1dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1012262967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00761fa9-50fa-49b0-8871-62011fcd3ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea5b796ac524bdca8c3087309a2943c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:58Z,use_quota=True,user_id='5a815dfdd201448b9764c73a1565dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc706336-cb2d-471a-b1e1-8f42864337ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc706336-cb2d-471a-b1e1-8f42864337ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bef5775-cb49-41a6-9472-de7559439370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bef5775-cb49-41a6-9472-de7559439370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00761fa9-50fa-49b0-8871-62011fcd3ba6', 'volume_name': 'volume-00761fa9-50fa-49b0-8871-62011fcd3ba6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e848e3-b449-47bf-a6d0-7614e533e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e848e3-b449-47bf-a6d0-7614e533e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2729699b-7c5d-4005-a8e0-41b8a5ac6ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Volume 00761fa9-50fa-49b0-8871-62011fcd3ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00761fa9-50fa-49b0-8871-62011fcd3ba6', 'volume_size': 1} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:58 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30" returned: 0 in 0.999s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] <== create_volume: return (2926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.929s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.169s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070741563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef913daf-1d08-4198-b129-075e8162d937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea5b796ac524bdca8c3087309a2943c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:56Z,use_quota=True,user_id='5a815dfdd201448b9764c73a1565dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Creating volume ef913daf-1d08-4198-b129-075e8162d937 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:21:58 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53bebf7d-8f19-430c-bb36-12a1343de4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53466786-2fbe-439e-b467-e220d5163e30', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:58 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937 1073741824 Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885ce9a0-9635-4169-ba90-8cabebcca25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:21:58 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Volume volume-53466786-2fbe-439e-b467-e220d5163e30 (53466786-2fbe-439e-b467-e220d5163e30): created successfully Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885ce9a0-9635-4169-ba90-8cabebcca25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Flow 'volume_create_manager' (b98fc876-4a63-4916-bfa2-de0370b78461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:21:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5d016993-82b5-41e8-af6e-7dc9deeb9806 tempest-CreateVolumesFromImageTest-913697151 None] Created volume successfully. Jul 06 12:21:58 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD" returned: 0 in 1.071s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:59 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD Jul 06 12:21:59 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:59 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937 1073741824" returned: 0 in 1.202s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:21:59 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937 Jul 06 12:21:59 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:21:59 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 06 12:21:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD" returned: 1 in 1.008s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:21:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:21:59 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] a27fd8ea-b4e7-422e-b4f7-564560484a59 was raw, converting to raw {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:21:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:00 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d Jul 06 12:22:00 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:00 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937" returned: 0 in 0.754s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.082s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1406159616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3719a692-9f62-4d4f-88f8-1f82eacbffdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6dd1031d8e405487deec42ff73358a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:57Z,use_quota=True,user_id='5093be3c113745c8bde965d6fbefa4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Creating volume 3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:00 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15eb6394-ba0c-48a2-adc4-94621e44ae23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef913daf-1d08-4198-b129-075e8162d937', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:00 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf 1073741824 Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1475ef1-77a8-43d0-b18d-369b014da13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:00 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:00 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Volume volume-ef913daf-1d08-4198-b129-075e8162d937 (ef913daf-1d08-4198-b129-075e8162d937): created successfully Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1475ef1-77a8-43d0-b18d-369b014da13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Flow 'volume_create_manager' (40678719-b695-441b-b66d-9483a27ee71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2f13d318-f541-4a73-8d53-9e8a9f76955b tempest-CreateVolumesFromImageTest-913697151 None] Created volume successfully. Jul 06 12:22:00 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d" returned: 0 in 0.852s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a27fd8ea-b4e7-422e-b4f7-564560484a59_e7031p1odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:22:00 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:22:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:00 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d 1G Jul 06 12:22:00 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:01 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf 1073741824" returned: 0 in 1.223s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:01 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf Jul 06 12:22:01 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:01 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d 1G" returned: 0 in 0.932s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e41421-b5d3-4f31-a7e6-99afdfb853a1]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:01 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d Jul 06 12:22:01 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:02 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf" returned: 0 in 1.044s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.053s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-305730636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff5d894-ff27-450a-a3c0-ddce6cec4646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea5b796ac524bdca8c3087309a2943c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:57Z,use_quota=True,user_id='5a815dfdd201448b9764c73a1565dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Creating volume dff5d894-ff27-450a-a3c0-ddce6cec4646 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:02 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3ac4e6-f60b-4704-8142-bbb33fef9de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c418a0d-7b8c-4ade-aba2-b46752eaf624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:02 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646 1073741824 Jul 06 12:22:02 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Volume volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf (3719a692-9f62-4d4f-88f8-1f82eacbffdf): created successfully Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c418a0d-7b8c-4ade-aba2-b46752eaf624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Flow 'volume_create_manager' (b3cc862f-7e7d-4133-a088-98537b28c4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0376f892-1009-4a9a-98e6-6856e28f8131 tempest-VolumesSnapshotListTestJSON-2074545974 None] Created volume successfully. Jul 06 12:22:02 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d" returned: 0 in 1.079s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:03 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d Jul 06 12:22:03 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:04 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646 1073741824" returned: 0 in 1.442s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:04 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d" returned: 1 in 1.323s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Downloaded image a27fd8ea-b4e7-422e-b4f7-564560484a59 ((None, [{'url': 'file:///opt/stack/data/glance/images/a27fd8ea-b4e7-422e-b4f7-564560484a59', 'metadata': {}}])) to volume c550c6b4-6665-454c-a53b-e8c6be753c2d successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Temporary image a27fd8ea-b4e7-422e-b4f7-564560484a59 for user 567795ed356c495a89949f6b89f135ec is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Marking volume c550c6b4-6665-454c-a53b-e8c6be753c2d as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:22:04 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646 Jul 06 12:22:04 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Copying metadata from image a27fd8ea-b4e7-422e-b4f7-564560484a59 to c550c6b4-6665-454c-a53b-e8c6be753c2d. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Creating volume glance metadata for volume c550c6b4-6665-454c-a53b-e8c6be753c2d backed by image a27fd8ea-b4e7-422e-b4f7-564560484a59 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a27fd8ea-b4e7-422e-b4f7-564560484a59', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f1380959c000e122946492ba97fa4970', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3539df-14e8-4d7a-8a7b-07bb58f6d21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c550c6b4-6665-454c-a53b-e8c6be753c2d', 'volume_size': 1, 'image_id': 'a27fd8ea-b4e7-422e-b4f7-564560484a59', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a27fd8ea-b4e7-422e-b4f7-564560484a59', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f1380959c000e122946492ba97fa4970', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d416fcddec04a6c8ad8a2881eb8b41c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f0e881dbad9d12e78af6877f0d99ed8c026fd395cabfb0b025b0718270438df55ffdcd4adb47ccb442fd76e1e571280df95e03c7e11bc73d5f961bc6cfd72ac9', 'id': 'a27fd8ea-b4e7-422e-b4f7-564560484a59', 'created_at': datetime.datetime(2026, 7, 6, 10, 21, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 21, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a27fd8ea-b4e7-422e-b4f7-564560484a59/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4760059d-10a9-4ce2-899e-3e4797d44d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:04 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Volume volume-c550c6b4-6665-454c-a53b-e8c6be753c2d (c550c6b4-6665-454c-a53b-e8c6be753c2d): created successfully Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4760059d-10a9-4ce2-899e-3e4797d44d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Flow 'volume_create_manager' (6050106d-6c7e-4213-a1ab-f5ee1948904a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-97c84345-235b-49e8-9d9c-95a6274e15b3 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Created volume successfully. Jul 06 12:22:04 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646" returned: 0 in 0.762s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.177s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809695788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea5b796ac524bdca8c3087309a2943c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:57Z,use_quota=True,user_id='5a815dfdd201448b9764c73a1565dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Creating volume d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:04 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:22:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:05 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1 1073741824 Jul 06 12:22:05 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfab09b-8e96-4502-a0ff-a931659277fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff5d894-ff27-450a-a3c0-ddce6cec4646', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f25a319-d141-4090-aec9-f02002d19784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Volume volume-dff5d894-ff27-450a-a3c0-ddce6cec4646 (dff5d894-ff27-450a-a3c0-ddce6cec4646): created successfully Jul 06 12:22:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f25a319-d141-4090-aec9-f02002d19784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Flow 'volume_create_manager' (ead6ce95-1c31-4feb-a2c3-2f27f8feb0c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-421e6b2d-a21f-4c32-a306-978cc5ae0525 tempest-CreateVolumesFromImageTest-913697151 None] Created volume successfully. Jul 06 12:22:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Acquiring lock "cinder-c550c6b4-6665-454c-a53b-e8c6be753c2d-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Lock "cinder-c550c6b4-6665-454c-a53b-e8c6be753c2d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Acquiring lock "cinder-quobyte-c550c6b4-6665-454c-a53b-e8c6be753c2d" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Lock "cinder-quobyte-c550c6b4-6665-454c-a53b-e8c6be753c2d" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f982685-4844-453f-b931-0f3b551e6ef9]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:05 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d Jul 06 12:22:05 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:06 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1 1073741824" returned: 0 in 1.123s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:06 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1 Jul 06 12:22:06 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:06 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d" returned: 0 in 0.951s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:06 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d Jul 06 12:22:06 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:06 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1" returned: 0 in 0.770s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.646s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1012262967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00761fa9-50fa-49b0-8871-62011fcd3ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea5b796ac524bdca8c3087309a2943c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:21:58Z,use_quota=True,user_id='5a815dfdd201448b9764c73a1565dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Creating volume 00761fa9-50fa-49b0-8871-62011fcd3ba6 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:06 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc354ee-575b-4ea6-b67b-f875b5f7a01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:06 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6 1073741824 Jul 06 12:22:06 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faa4cb7-5af9-4060-be8e-5828f769e1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Volume volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1 (d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1): created successfully Jul 06 12:22:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faa4cb7-5af9-4060-be8e-5828f769e1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Flow 'volume_create_manager' (4e7dd097-c687-4273-875d-67eb0a100cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-640ee6b5-c08d-40c5-8c9a-29d1949efcde tempest-CreateVolumesFromImageTest-913697151 None] Created volume successfully. Jul 06 12:22:07 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d" returned: 1 in 0.870s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:22:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:07 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d Jul 06 12:22:07 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:07 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6 1073741824" returned: 0 in 1.019s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:07 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c550c6b4-6665-454c-a53b-e8c6be753c2d" returned: 0 in 0.752s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Lock "cinder-quobyte-c550c6b4-6665-454c-a53b-e8c6be753c2d" released by "delete_volume" :: held 2.652s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:08 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6 Jul 06 12:22:08 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:08 devstack cinder-volume[86561]: WARNING cinder.quota [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:22:08 devstack cinder-volume[86561]: WARNING cinder.quota [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Created reservations ['97d9ae54-e29c-478c-859c-86d5dedaced9', 'e92f04d1-3744-4a84-b0aa-07612496a33b', '88122e35-8af9-4ae5-aa67-49850a50f117', '6444969b-8749-47c6-a235-9d970d469f80'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:08 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:08 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:08 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6" returned: 0 in 0.792s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.148s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2729699b-7c5d-4005-a8e0-41b8a5ac6ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00761fa9-50fa-49b0-8871-62011fcd3ba6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f2abef-dab7-4ad2-bd5f-c10269993f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] Creating offline snapshot 724fef1d-41d1-43cb-a361-da8cb7eaa887 of volume 3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:22:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Volume volume-00761fa9-50fa-49b0-8871-62011fcd3ba6 (00761fa9-50fa-49b0-8871-62011fcd3ba6): created successfully Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f2abef-dab7-4ad2-bd5f-c10269993f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Flow 'volume_create_manager' (6351b210-cfad-42f0-9b60-476447349fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8276f74-dee0-4874-86fd-6e040f83eb9d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-492cd65a-82c4-48ac-8028-23d0159ff42e tempest-CreateVolumesFromImageTest-913697151 None] Created volume successfully. Jul 06 12:22:09 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.814s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:09 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Deleted volume successfully. Jul 06 12:22:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac658628-35e4-4392-9879-1b36615eb6a8 tempest-VolumeAndVolumeTypeFromImageTest-1170947919 None] Lock "cinder-c550c6b4-6665-454c-a53b-e8c6be753c2d-delete_volume" released by "delete_volume" :: held 3.782s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:09 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf Jul 06 12:22:09 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "cinder-00761fa9-50fa-49b0-8871-62011fcd3ba6-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-00761fa9-50fa-49b0-8871-62011fcd3ba6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "cinder-quobyte-00761fa9-50fa-49b0-8871-62011fcd3ba6" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-quobyte-00761fa9-50fa-49b0-8871-62011fcd3ba6" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[59754caf-bb45-41fb-92e1-4d63a932fd77]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:09 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6 Jul 06 12:22:09 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:10 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf" returned: 0 in 1.085s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:10 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 1G Jul 06 12:22:10 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:10 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6" returned: 0 in 0.996s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:10 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6 Jul 06 12:22:10 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:11 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 1G" returned: 0 in 1.180s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:11 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 Jul 06 12:22:11 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:11 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00761fa9-50fa-49b0-8871-62011fcd3ba6" returned: 0 in 0.816s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-quobyte-00761fa9-50fa-49b0-8871-62011fcd3ba6" released by "delete_volume" :: held 1.892s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Created reservations ['0bbf2763-1b9c-4dae-8419-ecffc7c85422', '8afa551e-cadd-4a34-9a37-37b139057e4b', 'a0101159-c5e9-44f2-b35c-adb93e1f983a', '8c0de9fa-868c-4b37-b71a-a66f4af4e011'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:11 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:11 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "cinder-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "cinder-quobyte-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-quobyte-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1" acquired by "delete_volume" :: waited 0.044s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e48ab7-0069-4437-8589-79bf9cd88891]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:12 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1 Jul 06 12:22:12 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887" returned: 0 in 1.056s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:12 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 is being set with open permissions: ugo+rw Jul 06 12:22:12 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:12 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 Jul 06 12:22:12 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:12 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.043s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:12 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Deleted volume successfully. Jul 06 12:22:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-abd62907-afd8-486f-84d4-e232981218ef tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-00761fa9-50fa-49b0-8871-62011fcd3ba6-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1" returned: 0 in 1.119s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:13 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:13 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1 Jul 06 12:22:13 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:13 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887" returned: 0 in 1.113s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:13 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.info Jul 06 12:22:13 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:13 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1" returned: 0 in 0.972s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-quobyte-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1" released by "delete_volume" :: held 2.177s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:14 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Created reservations ['e6f2aba3-fa4e-4b6b-be74-a243d108a90e', '918ae070-6f72-486f-b190-eb4fe5a40e7f', 'bc949ddb-ebf6-4322-82c4-5233433b10af', 'e8e18cbe-048d-49d9-b904-0da9f420fe7a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:14 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.info" returned: 0 in 0.992s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:14 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.info is being set with open permissions: ugo+rw Jul 06 12:22:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:14 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:14 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:14 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.info Jul 06 12:22:14 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "cinder-dff5d894-ff27-450a-a3c0-ddce6cec4646-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-dff5d894-ff27-450a-a3c0-ddce6cec4646-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "cinder-quobyte-dff5d894-ff27-450a-a3c0-ddce6cec4646" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:15 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-quobyte-dff5d894-ff27-450a-a3c0-ddce6cec4646" acquired by "delete_volume" :: waited 0.044s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.info" returned: 0 in 1.154s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.777s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[10681954-2150-4e95-89d7-efde52d7d0db]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (3a213425-3169-449f-aab4-282ddc706ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6289c6a-6fbf-47ab-8855-d3059c1dd1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:15 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646 Jul 06 12:22:15 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:15 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6289c6a-6fbf-47ab-8855-d3059c1dd1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1906134268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fe8138-9286-4abc-866b-1d582bf4f035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:16Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f5a325-7dae-43a1-b557-81727535e403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f5a325-7dae-43a1-b557-81727535e403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdfd1bd-c0a3-4f9b-b3fe-9949aa8be376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdfd1bd-c0a3-4f9b-b3fe-9949aa8be376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80fe8138-9286-4abc-866b-1d582bf4f035', 'volume_name': 'volume-80fe8138-9286-4abc-866b-1d582bf4f035', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f67755-4b5f-4603-b5c1-9b7df72baf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f67755-4b5f-4603-b5c1-9b7df72baf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f483f6-b3bb-46b0-9a02-8c9ee500e1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume 80fe8138-9286-4abc-866b-1d582bf4f035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80fe8138-9286-4abc-866b-1d582bf4f035', 'volume_size': 1} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1906134268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fe8138-9286-4abc-866b-1d582bf4f035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:16Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Creating volume 80fe8138-9286-4abc-866b-1d582bf4f035 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:15 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:22:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-64ec37d2-5943-4a97-bea2-85611cea4c85 tempest-VolumesSnapshotListTestJSON-2074545974 None] Create snapshot completed successfully Jul 06 12:22:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.585s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:16 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:16 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035 1073741824 Jul 06 12:22:16 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Deleted volume successfully. Jul 06 12:22:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6b9e904e-393a-49a5-8418-b2397c70aeaa tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-d71cdd1d-fb76-43b5-931a-b49dd8ebd2d1-delete_volume" released by "delete_volume" :: held 4.348s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:16 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646" returned: 0 in 1.125s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:16 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646 Jul 06 12:22:16 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:17 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035 1073741824" returned: 0 in 1.193s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:17 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035 Jul 06 12:22:17 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:17 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dff5d894-ff27-450a-a3c0-ddce6cec4646" returned: 0 in 0.801s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-quobyte-dff5d894-ff27-450a-a3c0-ddce6cec4646" released by "delete_volume" :: held 2.013s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Created reservations ['1198fed9-398f-4efa-a961-0bd663ad85e8', 'a3316315-a12b-49c6-913b-c01ce1b5d6b6', '2d04d35f-3fe6-4c96-9e87-14a82936e044', '8dc67a8e-c3b2-4165-9217-b3c31fb5f697'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:17 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:17 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:17 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035" returned: 0 in 0.775s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.344s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f483f6-b3bb-46b0-9a02-8c9ee500e1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fe8138-9286-4abc-866b-1d582bf4f035', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df70387d-cc5b-485b-a973-3ca4c5bf9beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] Creating offline snapshot a6fc3431-7a35-4d8c-9489-f0222f183bbb of volume 3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:22:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume volume-80fe8138-9286-4abc-866b-1d582bf4f035 (80fe8138-9286-4abc-866b-1d582bf4f035): created successfully Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df70387d-cc5b-485b-a973-3ca4c5bf9beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (3a213425-3169-449f-aab4-282ddc706ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d3c331-40fa-491f-9957-68031fc5ea4a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e04eca64-6f24-4554-9eab-6f9766b451fd tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created volume successfully. Jul 06 12:22:18 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 Jul 06 12:22:18 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:18 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.784s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Deleted volume successfully. Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c9b9684c-accf-48c0-a629-6b6bc0a0bd68 tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-dff5d894-ff27-450a-a3c0-ddce6cec4646-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "cinder-ef913daf-1d08-4198-b129-075e8162d937-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-ef913daf-1d08-4198-b129-075e8162d937-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "cinder-quobyte-ef913daf-1d08-4198-b129-075e8162d937" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-quobyte-ef913daf-1d08-4198-b129-075e8162d937" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b67ae0b-4de2-4d13-910b-5c3623ffa40b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:19 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937 Jul 06 12:22:19 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:19 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887" returned: 0 in 1.085s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:19 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb 1G Jul 06 12:22:19 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (c199c419-ff08-4506-8c16-eb336bb0585f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca3ab59-e3ca-4c6f-beaa-17eec84104c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca3ab59-e3ca-4c6f-beaa-17eec84104c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-205824139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb62c113-df87-4535-8973-1ee152f20852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:19Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bfed72-066a-4d37-89e0-9c0691afdadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bfed72-066a-4d37-89e0-9c0691afdadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b3335a-ca90-4789-b231-e798bc5928cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b3335a-ca90-4789-b231-e798bc5928cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb62c113-df87-4535-8973-1ee152f20852', 'volume_name': 'volume-fb62c113-df87-4535-8973-1ee152f20852', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451b5530-20d5-4674-9c9f-dd5f4ceaf67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451b5530-20d5-4674-9c9f-dd5f4ceaf67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1de756a-f950-4718-a7bc-7f26232fd536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:19 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume fb62c113-df87-4535-8973-1ee152f20852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb62c113-df87-4535-8973-1ee152f20852', 'volume_size': 1} Jul 06 12:22:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (9ae28076-b323-4821-975f-7291b0217509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b8ca1a-6371-4b36-b306-b6bf5d4303d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b8ca1a-6371-4b36-b306-b6bf5d4303d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-628548928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b09b332-7f2d-43da-b3b8-fac9fe68276f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:20Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f96112-ad0b-47fd-80ed-cbb614c53bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f96112-ad0b-47fd-80ed-cbb614c53bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5873f231-e941-4d96-b20d-a176b7ad8360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5873f231-e941-4d96-b20d-a176b7ad8360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b09b332-7f2d-43da-b3b8-fac9fe68276f', 'volume_name': 'volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0deab453-0361-462d-8ecf-1db869c75b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0deab453-0361-462d-8ecf-1db869c75b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83512157-2dd4-4b92-a2a9-d2631f4a0516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:20 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume 6b09b332-7f2d-43da-b3b8-fac9fe68276f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f', 'volume_size': 1} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:20 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937" returned: 0 in 1.432s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:20 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937 Jul 06 12:22:20 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:20 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb 1G" returned: 0 in 1.762s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:21 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb Jul 06 12:22:21 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (37f7b8d5-7c9a-4881-9431-365d276f368f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5c6c79-d5df-4ee3-9a2f-cec38921a4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5c6c79-d5df-4ee3-9a2f-cec38921a4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1739630186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bd2aa0-960f-41ac-9a64-33c55fcbd4e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:21Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b460dfc7-cb8d-43fd-90f2-30203d907f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b460dfc7-cb8d-43fd-90f2-30203d907f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acee4bd-d15d-4e1a-b18a-b0a3b7b8bd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acee4bd-d15d-4e1a-b18a-b0a3b7b8bd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43bd2aa0-960f-41ac-9a64-33c55fcbd4e0', 'volume_name': 'volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe7c4c3-e6f3-4a56-a4c1-8c15de236741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe7c4c3-e6f3-4a56-a4c1-8c15de236741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a528f5-1815-47e8-ab6b-c907201453ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume 43bd2aa0-960f-41ac-9a64-33c55fcbd4e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0', 'volume_size': 1} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (07d54be8-a91c-4b22-86aa-00ed25611277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a199ac8-b772-4a4f-9fc2-ec586973d6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a199ac8-b772-4a4f-9fc2-ec586973d6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2033825785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba526dd6-2918-4869-b6e7-3dbefa8e7fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:22Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca7060b-34ab-49b9-bf24-e3569e7a58d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca7060b-34ab-49b9-bf24-e3569e7a58d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb41cf18-b0c9-41e3-ab28-7869bf875909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb41cf18-b0c9-41e3-ab28-7869bf875909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba526dd6-2918-4869-b6e7-3dbefa8e7fbe', 'volume_name': 'volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08d6b6e-a63e-4e89-99a6-29404ed8dd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08d6b6e-a63e-4e89-99a6-29404ed8dd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccd383e-da7a-4314-9fbf-a2fdc0db2dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume ba526dd6-2918-4869-b6e7-3dbefa8e7fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe', 'volume_size': 1} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:21 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ef913daf-1d08-4198-b129-075e8162d937" returned: 0 in 1.472s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-quobyte-ef913daf-1d08-4198-b129-075e8162d937" released by "delete_volume" :: held 2.992s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Created reservations ['c5184973-b55d-4bbc-b6c5-b5430289d507', '176e285a-5eaf-436c-b69b-eb4dd74a4598', 'c721124d-a2fb-4a29-87de-6fa99d33db28', '460c9a35-bc4f-4f04-b940-a834351b518e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:22 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:22 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:22 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb" returned: 0 in 1.525s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:22 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb is being set with open permissions: ugo+rw Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:22 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb Jul 06 12:22:22 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "cinder-53466786-2fbe-439e-b467-e220d5163e30-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (a19cac2e-46cc-40f2-8881-449d0c1abe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbce3f3c-df1b-4063-a86f-042827053b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbce3f3c-df1b-4063-a86f-042827053b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1478763317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ca6aca-0620-4d27-8955-04c97bebc048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:22Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa63f306-5b03-4e18-a940-87c32bc5cbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa63f306-5b03-4e18-a940-87c32bc5cbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e89b9d-57f7-47b8-b42f-0a1173a14841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e89b9d-57f7-47b8-b42f-0a1173a14841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ca6aca-0620-4d27-8955-04c97bebc048', 'volume_name': 'volume-44ca6aca-0620-4d27-8955-04c97bebc048', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63c3faf-7d06-49d6-95b0-ac6314936cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63c3faf-7d06-49d6-95b0-ac6314936cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec59992-9006-448a-958b-151ff9b1c93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume 44ca6aca-0620-4d27-8955-04c97bebc048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ca6aca-0620-4d27-8955-04c97bebc048', 'volume_size': 1} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-53466786-2fbe-439e-b467-e220d5163e30-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "cinder-quobyte-53466786-2fbe-439e-b467-e220d5163e30" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-quobyte-53466786-2fbe-439e-b467-e220d5163e30" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4373cb9-f8ad-45a1-962f-6afadac76df1]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:22 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30 Jul 06 12:22:22 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:23 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.079s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Deleted volume successfully. Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fdd5cc54-b8fb-4f94-bc52-778c7e12c45a tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-ef913daf-1d08-4198-b129-075e8162d937-delete_volume" released by "delete_volume" :: held 4.616s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:23 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb" returned: 0 in 1.185s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.744s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.073s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-205824139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb62c113-df87-4535-8973-1ee152f20852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:19Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Creating volume fb62c113-df87-4535-8973-1ee152f20852 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:23 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:23 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852 1073741824 Jul 06 12:22:23 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9827dc23-4abd-4dab-ba6f-0ba2bad1a990 tempest-VolumesSnapshotListTestJSON-2074545974 None] Create snapshot completed successfully Jul 06 12:22:23 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30" returned: 0 in 1.150s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:23 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30 Jul 06 12:22:23 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:25 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53466786-2fbe-439e-b467-e220d5163e30" returned: 0 in 1.363s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-quobyte-53466786-2fbe-439e-b467-e220d5163e30" released by "delete_volume" :: held 2.567s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Created reservations ['49866d2a-592c-4596-8e28-795863085990', '76ca7c86-c26f-4de2-a4fc-c91fde211f26', '6c8b39f3-5d10-4c6c-ac6d-36c518d98d5b', 'e48a82a9-14d4-411b-8571-970078b03d14'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:25 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852 1073741824" returned: 0 in 1.718s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:25 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852 Jul 06 12:22:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:25 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:25 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:25 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:26 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.993s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:26 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852" returned: 0 in 1.064s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] <== create_volume: return (2841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.846s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Deleted volume successfully. Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.407s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-628548928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b09b332-7f2d-43da-b3b8-fac9fe68276f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:20Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Creating volume 6b09b332-7f2d-43da-b3b8-fac9fe68276f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:26 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:26 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f 1073741824 Jul 06 12:22:26 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1de756a-f950-4718-a7bc-7f26232fd536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb62c113-df87-4535-8973-1ee152f20852', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5b67e5-ab93-43f7-9892-ac7415b11cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8e8f172b-f0ea-4205-a589-3fae8ee8ae26 tempest-CreateVolumesFromImageTest-913697151 None] Lock "cinder-53466786-2fbe-439e-b467-e220d5163e30-delete_volume" released by "delete_volume" :: held 4.028s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume volume-fb62c113-df87-4535-8973-1ee152f20852 (fb62c113-df87-4535-8973-1ee152f20852): created successfully Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5b67e5-ab93-43f7-9892-ac7415b11cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (c199c419-ff08-4506-8c16-eb336bb0585f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ecf797a9-13a1-4a63-918f-0430364b1edf tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created volume successfully. Jul 06 12:22:27 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f 1073741824" returned: 0 in 1.289s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:28 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f Jul 06 12:22:28 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:29 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f" returned: 0 in 1.218s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] <== create_volume: return (2581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.588s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.926s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1739630186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bd2aa0-960f-41ac-9a64-33c55fcbd4e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:21Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Creating volume 43bd2aa0-960f-41ac-9a64-33c55fcbd4e0 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:29 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=107,cinder:UPDATE=124,cinder:DELETE=13,cinder:INSERT=33 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83512157-2dd4-4b92-a2a9-d2631f4a0516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:29 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0 1073741824 Jul 06 12:22:29 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661dea39-4fb4-49cb-ba06-2df1d26a12e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f (6b09b332-7f2d-43da-b3b8-fac9fe68276f): created successfully Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661dea39-4fb4-49cb-ba06-2df1d26a12e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (9ae28076-b323-4821-975f-7291b0217509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-542af9b7-5fa4-406e-8e52-2d80ec02e25c tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created volume successfully. Jul 06 12:22:30 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0 1073741824" returned: 0 in 1.269s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:30 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0 Jul 06 12:22:30 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:31 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0" returned: 0 in 0.741s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.438s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2033825785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba526dd6-2918-4869-b6e7-3dbefa8e7fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:22Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Creating volume ba526dd6-2918-4869-b6e7-3dbefa8e7fbe {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:31 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a528f5-1815-47e8-ab6b-c907201453ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:31 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe 1073741824 Jul 06 12:22:31 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07d7ea5-b75b-4d03-ba3d-ecec706b6791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0 (43bd2aa0-960f-41ac-9a64-33c55fcbd4e0): created successfully Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07d7ea5-b75b-4d03-ba3d-ecec706b6791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (37f7b8d5-7c9a-4881-9431-365d276f368f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8c57b19a-7ca3-4038-bc64-5ebd9184fcbc tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created volume successfully. Jul 06 12:22:32 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe 1073741824" returned: 0 in 1.103s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:32 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe Jul 06 12:22:32 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:22:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:32 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:32 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:33 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe" returned: 0 in 0.854s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.630s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1478763317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ca6aca-0620-4d27-8955-04c97bebc048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3556dae0be740b5a34a4c77161153c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:22Z,use_quota=True,user_id='1f9aedd9491f41d481ae9295bd0d5b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Creating volume 44ca6aca-0620-4d27-8955-04c97bebc048 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:33 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccd383e-da7a-4314-9fbf-a2fdc0db2dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfddb54-b897-4f69-b08c-d023fe6f19cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:33 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048 1073741824 Jul 06 12:22:33 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:33 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe (ba526dd6-2918-4869-b6e7-3dbefa8e7fbe): created successfully Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfddb54-b897-4f69-b08c-d023fe6f19cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (07d54be8-a91c-4b22-86aa-00ed25611277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ff0936ea-19c1-4b50-96e1-c0f0fd7bd1b8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created volume successfully. Jul 06 12:22:34 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.173s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:34 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:22:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:22:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:22:34 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048 1073741824" returned: 0 in 1.469s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:34 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048 Jul 06 12:22:34 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:35 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048" returned: 0 in 0.876s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] <== create_volume: return (2398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.404s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec59992-9006-448a-958b-151ff9b1c93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ca6aca-0620-4d27-8955-04c97bebc048', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7ce4a8-cc4f-47d3-b4d5-042409d48517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] Creating offline snapshot f49b2af6-c4da-4194-a988-ca1cd1471524 of volume 3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:22:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Volume volume-44ca6aca-0620-4d27-8955-04c97bebc048 (44ca6aca-0620-4d27-8955-04c97bebc048): created successfully Jul 06 12:22:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7ce4a8-cc4f-47d3-b4d5-042409d48517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Flow 'volume_create_manager' (a19cac2e-46cc-40f2-8881-449d0c1abe33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db51d88-289b-4196-933e-dbf94ba67e2b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0f9cb6f8-cade-4ad1-b430-25fec15094d8 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created volume successfully. Jul 06 12:22:35 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb Jul 06 12:22:35 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-44ca6aca-0620-4d27-8955-04c97bebc048-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-44ca6aca-0620-4d27-8955-04c97bebc048-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-quobyte-44ca6aca-0620-4d27-8955-04c97bebc048" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-44ca6aca-0620-4d27-8955-04c97bebc048" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b3b107-c90b-4294-b292-dfa2dc9a0ac8]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:36 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048 Jul 06 12:22:36 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:37 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb" returned: 0 in 1.150s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:22:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:37 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 1G Jul 06 12:22:37 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:37 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048" returned: 0 in 1.126s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:37 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048 Jul 06 12:22:37 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:38 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 1G" returned: 0 in 1.285s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:38 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 Jul 06 12:22:38 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:38 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-44ca6aca-0620-4d27-8955-04c97bebc048" returned: 0 in 0.771s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-44ca6aca-0620-4d27-8955-04c97bebc048" released by "delete_volume" :: held 1.979s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created reservations ['eea96b4e-fc6c-415a-bc37-a30fdc47582c', '163e630f-fe5f-4166-b642-a13e8df8ebd7', '16bd526a-96c6-4fce-bf23-2b4781376bc5', '8b81834c-7b83-49f6-9a4c-6356712839f2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:38 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:38 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-quobyte-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7566c161-adcf-41b9-ac07-8ebd27a451b0]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:38 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe Jul 06 12:22:38 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:39 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524" returned: 0 in 1.024s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:39 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 is being set with open permissions: ugo+rw Jul 06 12:22:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:39 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 Jul 06 12:22:39 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:39 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.010s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:39 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Deleted volume successfully. Jul 06 12:22:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f14fd8be-89b7-4fa0-8461-c2f480fa4586 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-44ca6aca-0620-4d27-8955-04c97bebc048-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:39 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe" returned: 0 in 1.134s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:40 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe Jul 06 12:22:40 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:40 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524" returned: 0 in 0.899s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.540s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:40 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-262e085a-9f03-4e72-931f-4bd83dae6911 tempest-VolumesSnapshotListTestJSON-2074545974 None] Create snapshot completed successfully Jul 06 12:22:40 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe" returned: 0 in 0.873s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe" released by "delete_volume" :: held 2.077s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:40 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created reservations ['39eda088-6cb5-4a33-8488-8961ca96e38d', 'c9f27795-7f31-4145-97aa-e9a2ad5f1eab', 'f5fb3d76-9e4a-426c-83ce-6d552b8c1a78', 'b2485653-306d-4585-8ade-df585c45646a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:41 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:41 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "cinder-f49b2af6-c4da-4194-a988-ca1cd1471524-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-f49b2af6-c4da-4194-a988-ca1cd1471524-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "cinder-quobyte-f49b2af6-c4da-4194-a988-ca1cd1471524" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-f49b2af6-c4da-4194-a988-ca1cd1471524" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Deleting offline snapshot f49b2af6-c4da-4194-a988-ca1cd1471524 of volume 3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] snapshot_file for this snap is: volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[64091303-e6a3-4b0d-a21e-79feb269a910]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:41 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 Jul 06 12:22:41 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:42 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.059s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:42 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Deleted volume successfully. Jul 06 12:22:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-700f62ee-5eef-4545-9433-7348cc419817 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-ba526dd6-2918-4869-b6e7-3dbefa8e7fbe-delete_volume" released by "delete_volume" :: held 3.564s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-quobyte-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9628850c-3487-404c-b046-8093bb833cac]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:42 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0 Jul 06 12:22:42 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:43 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524" returned: 0 in 1.209s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:22:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1fea9d-eb4c-4dbe-b789-84924677287e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:43 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb Jul 06 12:22:43 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:43 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0" returned: 0 in 1.136s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:43 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0 Jul 06 12:22:43 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:44 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb" returned: 0 in 1.273s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:44 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 Jul 06 12:22:44 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:44 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0" returned: 0 in 1.069s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0" released by "delete_volume" :: held 2.280s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created reservations ['46da7ebe-f0a1-4e20-a5ba-fdf0455150a7', '4f7722f0-3b13-404d-8481-9cd3d1a63e9a', 'ca5f7870-41b7-4a56-8d3b-63518a320eed', 'a792c5b3-693b-4fd9-a283-a999e54f6205'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:44 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:44 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-6b09b332-7f2d-43da-b3b8-fac9fe68276f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-6b09b332-7f2d-43da-b3b8-fac9fe68276f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-quobyte-6b09b332-7f2d-43da-b3b8-fac9fe68276f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:45 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524" returned: 0 in 1.507s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-6b09b332-7f2d-43da-b3b8-fac9fe68276f" acquired by "delete_volume" :: waited 0.047s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:45 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524 Jul 06 12:22:45 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[88683e05-c4f0-4644-b54d-460d0b411525]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:45 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.167s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:46 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Deleted volume successfully. Jul 06 12:22:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-96b36e0e-876b-4296-acaa-ad94875710f3 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-43bd2aa0-960f-41ac-9a64-33c55fcbd4e0-delete_volume" released by "delete_volume" :: held 3.838s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:46 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f Jul 06 12:22:46 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:46 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.f49b2af6-c4da-4194-a988-ca1cd1471524" returned: 0 in 0.920s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-f49b2af6-c4da-4194-a988-ca1cd1471524" released by "_delete_snapshot" :: held 5.072s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" released by "delete_snapshot" :: held 5.103s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:46 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Created reservations ['d627d5aa-103a-4314-8274-050ace2005e0', '87244835-3e36-469e-8301-a5718974acbe', '9d6820e8-aca6-4dbc-8c18-2dc9c1280674', '653b7a10-9d2a-4dbe-8496-ffed48f44df1'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Delete snapshot completed successfully. Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-065d4095-4119-4745-888b-2811d635b75b tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-f49b2af6-c4da-4194-a988-ca1cd1471524-delete_snapshot" released by "delete_snapshot" :: held 5.297s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:47 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f" returned: 0 in 1.105s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "cinder-a6fc3431-7a35-4d8c-9489-f0222f183bbb-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:47 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f Jul 06 12:22:47 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-a6fc3431-7a35-4d8c-9489-f0222f183bbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "cinder-quobyte-a6fc3431-7a35-4d8c-9489-f0222f183bbb" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-a6fc3431-7a35-4d8c-9489-f0222f183bbb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Deleting offline snapshot a6fc3431-7a35-4d8c-9489-f0222f183bbb of volume 3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] snapshot_file for this snap is: volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffd45d5-d74d-4c63-bb42-104a1136937a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:47 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb Jul 06 12:22:47 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:47 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b09b332-7f2d-43da-b3b8-fac9fe68276f" returned: 0 in 0.784s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-6b09b332-7f2d-43da-b3b8-fac9fe68276f" released by "delete_volume" :: held 1.963s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:48 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created reservations ['7dbb9c98-db23-4064-8153-f7c986fa4b64', '4e482469-cb74-43a0-95d9-589e177ec5cd', 'e0934598-0fe7-48fa-8709-25ad0c567684', '896eb126-165f-4664-b709-3682679a7095'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:48 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb" returned: 0 in 0.939s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:22:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:48 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e10a5b2-a080-4697-8aaa-dee592c318ee]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:48 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:48 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:48 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 Jul 06 12:22:48 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:49 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.824s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Deleted volume successfully. Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-452ae8df-7706-44f1-bd06-48e8f4ddfe2e tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-6b09b332-7f2d-43da-b3b8-fac9fe68276f-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:49 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887" returned: 0 in 1.045s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Flow 'volume_create_manager' (e440d7a3-6b2a-4014-9132-acab468fa1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:49 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb Jul 06 12:22:49 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb85d383-1438-440a-9d9b-4a1f00f86fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-fb62c113-df87-4535-8973-1ee152f20852-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb85d383-1438-440a-9d9b-4a1f00f86fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1038698772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2d0baa-a780-4cdb-a8ea-be254ff20de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bccd738c6944ce946f9903cae833c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:49Z,use_quota=True,user_id='2cbd8cc0990d4821837dc77bd62fb401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039587c5-f2d9-4546-bff4-6955561b8fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039587c5-f2d9-4546-bff4-6955561b8fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc232f4-2dd9-4554-a032-95e70b0e35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc232f4-2dd9-4554-a032-95e70b0e35b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd2d0baa-a780-4cdb-a8ea-be254ff20de9', 'volume_name': 'volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5b4907-863b-4b44-9c3a-c73527fc48a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5b4907-863b-4b44-9c3a-c73527fc48a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01c1856-4dde-4560-8adb-beeb2fc29258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:49 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Volume dd2d0baa-a780-4cdb-a8ea-be254ff20de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9', 'volume_size': 1} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1038698772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2d0baa-a780-4cdb-a8ea-be254ff20de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bccd738c6944ce946f9903cae833c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:22:49Z,use_quota=True,user_id='2cbd8cc0990d4821837dc77bd62fb401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Creating volume dd2d0baa-a780-4cdb-a8ea-be254ff20de9 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:22:49 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-fb62c113-df87-4535-8973-1ee152f20852-delete_volume" acquired by "delete_volume" :: waited 0.216s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:49 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 1073741824 Jul 06 12:22:49 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-quobyte-fb62c113-df87-4535-8973-1ee152f20852" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-fb62c113-df87-4535-8973-1ee152f20852" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c8c117-dcd3-4ab6-af40-3c2cf23b274c]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:49 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852 Jul 06 12:22:49 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:50 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb" returned: 0 in 1.511s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:50 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb Jul 06 12:22:50 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:50 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 1073741824" returned: 0 in 1.343s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:50 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 Jul 06 12:22:50 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:51 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852" returned: 0 in 1.268s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:51 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852 Jul 06 12:22:51 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:51 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.a6fc3431-7a35-4d8c-9489-f0222f183bbb" returned: 0 in 1.066s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-a6fc3431-7a35-4d8c-9489-f0222f183bbb" released by "_delete_snapshot" :: held 4.747s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" released by "delete_snapshot" :: held 4.783s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:52 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fb62c113-df87-4535-8973-1ee152f20852" returned: 0 in 1.057s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-fb62c113-df87-4535-8973-1ee152f20852" released by "delete_volume" :: held 2.394s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Created reservations ['93cae8a1-ac94-454d-b887-7dd9ac04e5ca', 'b384cb1d-2472-4515-86c2-45ca79e6168c', 'fa5caaaf-0326-410d-8af6-e6ceea2a4775', '1c098f6e-6be4-4586-b4d9-85e8792758d6'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:52 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9" returned: 0 in 1.323s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] <== create_volume: return (2752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.755s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01c1856-4dde-4560-8adb-beeb2fc29258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82d93e7-72a7-4ff4-8127-a7e99885537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:22:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Delete snapshot completed successfully. Jul 06 12:22:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Volume volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 (dd2d0baa-a780-4cdb-a8ea-be254ff20de9): created successfully Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82d93e7-72a7-4ff4-8127-a7e99885537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Flow 'volume_create_manager' (e440d7a3-6b2a-4014-9132-acab468fa1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-319d7945-0aa7-43d6-8f7d-946074d3c9a0 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-a6fc3431-7a35-4d8c-9489-f0222f183bbb-delete_snapshot" released by "delete_snapshot" :: held 5.177s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created reservations ['4001d320-a58f-4ee8-8373-4d17ab2ce2d3', '75400711-962d-40f5-9bd6-d265581e08b8', '13137857-dce8-4486-99d9-206decbfd6f0', '94c6e247-b67a-439f-9869-11813a3521c0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f6b3aae8-25ca-4058-9dc6-1cabfce0781a tempest-AttachVolumeNegativeTest-428349029 None] Created volume successfully. Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:52 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:52 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "cinder-724fef1d-41d1-43cb-a361-da8cb7eaa887-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-724fef1d-41d1-43cb-a361-da8cb7eaa887-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "cinder-quobyte-724fef1d-41d1-43cb-a361-da8cb7eaa887" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-724fef1d-41d1-43cb-a361-da8cb7eaa887" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Deleting offline snapshot 724fef1d-41d1-43cb-a361-da8cb7eaa887 of volume 3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] snapshot_file for this snap is: volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-80fe8138-9286-4abc-866b-1d582bf4f035-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[513d9ca1-e110-4418-ac58-f3d3bdb320e8]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-80fe8138-9286-4abc-866b-1d582bf4f035-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "cinder-quobyte-80fe8138-9286-4abc-866b-1d582bf4f035" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-80fe8138-9286-4abc-866b-1d582bf4f035" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbee003-89a7-471f-bcfa-093e963d2c3e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:53 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 Jul 06 12:22:53 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:53 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035 Jul 06 12:22:53 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:53 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.198s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:53 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Deleted volume successfully. Jul 06 12:22:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b504de6d-5232-43ae-a18b-f3066c30ca53 tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-fb62c113-df87-4535-8973-1ee152f20852-delete_volume" released by "delete_volume" :: held 4.154s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:54 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887" returned: 0 in 1.261s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:22:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59f0c07-b3ed-4dc2-b7d7-c69b448e0fba]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:54 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf Jul 06 12:22:54 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:54 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035" returned: 0 in 1.318s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:54 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035 Jul 06 12:22:54 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:55 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf" returned: 0 in 1.060s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:55 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-80fe8138-9286-4abc-866b-1d582bf4f035" returned: 0 in 0.903s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:55 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 Jul 06 12:22:55 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-quobyte-80fe8138-9286-4abc-866b-1d582bf4f035" released by "delete_volume" :: held 2.290s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:55 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Created reservations ['f8eb1ca5-55f6-4ef9-b217-ddb1915bd685', 'eb6eaf3c-f47e-4ce9-ad02-c0c6a1c21240', 'e10b1d42-91c4-4a29-9c25-0262ac69ada6', '1e6e0f55-6dd5-4d6f-b97f-b45b669172b2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:22:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:22:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:55 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:22:55 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-bf23f8b7-c173-4bf5-bd93-45a5cc4376b5 req-83299f90-3453-4b5b-a083-976ac6616e97 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:22:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-bf23f8b7-c173-4bf5-bd93-45a5cc4376b5 req-83299f90-3453-4b5b-a083-976ac6616e97 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:22:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[df14347d-2d97-4305-8efe-8003324ce2ca]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-bf23f8b7-c173-4bf5-bd93-45a5cc4376b5 req-83299f90-3453-4b5b-a083-976ac6616e97 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:56 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 Jul 06 12:22:56 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:56 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887" returned: 0 in 1.387s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:56 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.162s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:56 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:22:56 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887 Jul 06 12:22:56 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:56 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Deleted volume successfully. Jul 06 12:22:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3cd669cc-55c8-43eb-8325-0289b8dac26d tempest-CreateVolumesFromSourceVolumeTest-868747921 None] Lock "cinder-80fe8138-9286-4abc-866b-1d582bf4f035-delete_volume" released by "delete_volume" :: held 3.835s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:57 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-bf23f8b7-c173-4bf5-bd93-45a5cc4376b5 req-83299f90-3453-4b5b-a083-976ac6616e97 tempest-AttachVolumeNegativeTest-428349029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9" returned: 0 in 1.041s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-bf23f8b7-c173-4bf5-bd93-45a5cc4376b5 req-83299f90-3453-4b5b-a083-976ac6616e97 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.066s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:22:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-bf23f8b7-c173-4bf5-bd93-45a5cc4376b5 req-83299f90-3453-4b5b-a083-976ac6616e97 tempest-AttachVolumeNegativeTest-428349029 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '066469a3-8092-4d3a-9b6a-c48ecf507fae', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:22:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-bf23f8b7-c173-4bf5-bd93-45a5cc4376b5 req-83299f90-3453-4b5b-a083-976ac6616e97 tempest-AttachVolumeNegativeTest-428349029 None] attachment_update completed successfully. Jul 06 12:22:57 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf.724fef1d-41d1-43cb-a361-da8cb7eaa887" returned: 0 in 0.821s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-724fef1d-41d1-43cb-a361-da8cb7eaa887" released by "_delete_snapshot" :: held 4.789s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" released by "delete_snapshot" :: held 4.858s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:57 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=100,cinder:UPDATE=163,cinder:DELETE=13,cinder:INSERT=43 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:22:57 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Created reservations ['a02720bd-d965-4396-be01-93e5bb4859d8', '88530f5d-0844-45b3-9e16-3937c5cdbc39', 'd544ba26-4386-400d-a33a-da02f3566946', '9e3783a7-2c16-46f9-afff-72e8d0f29513'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:22:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Delete snapshot completed successfully. Jul 06 12:22:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f384735f-6cd1-4f2d-93ca-f1d8b5ab0caa tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-724fef1d-41d1-43cb-a361-da8cb7eaa887-delete_snapshot" released by "delete_snapshot" :: held 5.176s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:22:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "cinder-3719a692-9f62-4d4f-88f8-1f82eacbffdf-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-3719a692-9f62-4d4f-88f8-1f82eacbffdf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:22:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:22:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[46211862-ef30-4d61-a713-19a496853c73]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:22:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:58 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf Jul 06 12:22:58 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:22:59 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Jul 06 12:22:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf" returned: 0 in 1.124s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:22:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:22:59 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf Jul 06 12:22:59 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:00 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3719a692-9f62-4d4f-88f8-1f82eacbffdf" returned: 0 in 0.884s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-quobyte-3719a692-9f62-4d4f-88f8-1f82eacbffdf" released by "delete_volume" :: held 2.105s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:00 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Created reservations ['5ecfa237-eeeb-4e9f-a7fe-80ef60f2a45c', '0963aab4-1147-41ac-9617-130e0714db47', '8e7c3f8e-462d-4af0-9224-92fe21f25037', '051e9917-d32a-4fd7-9bf1-91962c87f047'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:00 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:23:00 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:01 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.835s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Deleted volume successfully. Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Flow 'volume_create_manager' (1b9fb273-490a-476d-8020-f9a2d0f7cf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2799e795-38ce-4abf-9ce0-b3b5bfb5cf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dd7bf9db-c15c-419a-915d-77230cb0c5f6 tempest-VolumesSnapshotListTestJSON-2074545974 None] Lock "cinder-3719a692-9f62-4d4f-88f8-1f82eacbffdf-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2799e795-38ce-4abf-9ce0-b3b5bfb5cf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1596826704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5315d45-14bf-478d-8552-b2ede2cece1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f57f0bf43e04a5990b9a3fd38bbc98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:01Z,use_quota=True,user_id='cc8a4ed415d348dcb090dd978dff1e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63319253-5463-418d-a71a-ebacd666a45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63319253-5463-418d-a71a-ebacd666a45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa8400d-ff79-40d7-8b20-bc93393265c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa8400d-ff79-40d7-8b20-bc93393265c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5315d45-14bf-478d-8552-b2ede2cece1d', 'volume_name': 'volume-f5315d45-14bf-478d-8552-b2ede2cece1d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8345f58f-0afc-4b03-9b2d-de1474e2593d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8345f58f-0afc-4b03-9b2d-de1474e2593d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d40dbd-2bd1-40de-8b0e-ea34e93b2507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Volume f5315d45-14bf-478d-8552-b2ede2cece1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5315d45-14bf-478d-8552-b2ede2cece1d', 'volume_size': 1} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1596826704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5315d45-14bf-478d-8552-b2ede2cece1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f57f0bf43e04a5990b9a3fd38bbc98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:01Z,use_quota=True,user_id='cc8a4ed415d348dcb090dd978dff1e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Creating volume f5315d45-14bf-478d-8552-b2ede2cece1d {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:01 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:23:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:01 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d 1073741824 Jul 06 12:23:01 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:02 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d 1073741824" returned: 0 in 1.188s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:02 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d Jul 06 12:23:02 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:03 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d" returned: 0 in 1.064s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] <== create_volume: return (2319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.322s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d40dbd-2bd1-40de-8b0e-ea34e93b2507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5315d45-14bf-478d-8552-b2ede2cece1d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97145467-846b-41f8-b366-6eaf7643cd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:03 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Volume volume-f5315d45-14bf-478d-8552-b2ede2cece1d (f5315d45-14bf-478d-8552-b2ede2cece1d): created successfully Jul 06 12:23:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97145467-846b-41f8-b366-6eaf7643cd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Flow 'volume_create_manager' (1b9fb273-490a-476d-8020-f9a2d0f7cf89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-939d2a7c-adc0-483b-bb31-7b8e84f99d38 tempest-VolumeDependencyTests-1040373355 None] Created volume successfully. Jul 06 12:23:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] Creating offline snapshot 70d61157-2c48-42bb-9e12-2d1751b10f34 of volume f5315d45-14bf-478d-8552-b2ede2cece1d {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:23:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-a2cde5e6-fbef-4372-bc5f-1de3b180d044 req-bc520f6c-b47a-4ee0-99e7-1932d0b4c2bc tempest-AttachVolumeNegativeTest-428349029 None] Terminate volume connection completed successfully. Jul 06 12:23:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-a2cde5e6-fbef-4372-bc5f-1de3b180d044 req-bc520f6c-b47a-4ee0-99e7-1932d0b4c2bc tempest-AttachVolumeNegativeTest-428349029 None] Deleting attachment 066469a3-8092-4d3a-9b6a-c48ecf507fae. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:23:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6f5216-5912-4416-abb6-f34f8a896bf4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:05 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d Jul 06 12:23:05 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:06 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d" returned: 0 in 1.250s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:06 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 1G Jul 06 12:23:06 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Flow 'volume_create_manager' (d0c8ee07-f19f-4c9c-91c4-abfb6910780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bc6d95-a2ca-440f-8bb2-c1c5fea8b242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bc6d95-a2ca-440f-8bb2-c1c5fea8b242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1157110360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40063c7b-8112-4401-95d3-85c302573394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad79adb4be44efcb569f67eeb3d5cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:06Z,use_quota=True,user_id='ab7be96a80b14bad9b75af3403e98efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f64717-1f31-41d8-aadf-7a7b38b73a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f64717-1f31-41d8-aadf-7a7b38b73a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1698b9-0e24-460e-a764-ff32b76a9fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1698b9-0e24-460e-a764-ff32b76a9fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40063c7b-8112-4401-95d3-85c302573394', 'volume_name': 'volume-40063c7b-8112-4401-95d3-85c302573394', 'volume_size': 2}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76307e7-ba14-4a75-9ce2-181df0ace46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76307e7-ba14-4a75-9ce2-181df0ace46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91d01ec-197c-4451-8296-ffc21aa65b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Volume 40063c7b-8112-4401-95d3-85c302573394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40063c7b-8112-4401-95d3-85c302573394', 'volume_size': 2} Jul 06 12:23:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:07 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 1G" returned: 0 in 1.026s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5315d45-14bf-478d-8552-b2ede2cece1d -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:07 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5315d45-14bf-478d-8552-b2ede2cece1d -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 Jul 06 12:23:07 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:08 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5315d45-14bf-478d-8552-b2ede2cece1d -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34" returned: 0 in 0.873s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:08 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 is being set with open permissions: ugo+rw Jul 06 12:23:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:08 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 Jul 06 12:23:08 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:08 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34" returned: 0 in 0.795s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:09 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.info Jul 06 12:23:09 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:10 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.info" returned: 0 in 1.157s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:10 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.info is being set with open permissions: ugo+rw Jul 06 12:23:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:10 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.info Jul 06 12:23:10 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:11 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.info" returned: 0 in 0.877s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.101s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.603s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1157110360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40063c7b-8112-4401-95d3-85c302573394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad79adb4be44efcb569f67eeb3d5cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:06Z,use_quota=True,user_id='ab7be96a80b14bad9b75af3403e98efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Creating volume 40063c7b-8112-4401-95d3-85c302573394 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:11 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:23:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 2147483648 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:11 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 2147483648 Jul 06 12:23:11 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-703f57c9-d7a4-44e0-b8e3-55f49d814764 tempest-VolumeDependencyTests-1040373355 None] Create snapshot completed successfully Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Flow 'volume_create_manager' (ce3aa97c-70b2-4df9-a63c-d65153f94f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdd44a7-7278-42b9-9c68-17b35cc6f32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdd44a7-7278-42b9-9c68-17b35cc6f32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-256735148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69ab60b-77cf-493f-9ea9-9b93d2c3996f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f57f0bf43e04a5990b9a3fd38bbc98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=70d61157-2c48-42bb-9e12-2d1751b10f34,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:12Z,use_quota=True,user_id='cc8a4ed415d348dcb090dd978dff1e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9bd301-04c8-449b-9988-b792a9aab090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9bd301-04c8-449b-9988-b792a9aab090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096cb2e6-5332-4770-a449-f72f14cd34c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096cb2e6-5332-4770-a449-f72f14cd34c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd69ab60b-77cf-493f-9ea9-9b93d2c3996f', 'volume_name': 'volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f', 'volume_size': 1, 'snapshot_id': '70d61157-2c48-42bb-9e12-2d1751b10f34'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90a8505-9e63-42eb-b2ab-78ad02d3281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90a8505-9e63-42eb-b2ab-78ad02d3281f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e13542-acd4-4b30-9ae4-bd297f08dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Volume d69ab60b-77cf-493f-9ea9-9b93d2c3996f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f', 'volume_size': 1, 'snapshot_id': '70d61157-2c48-42bb-9e12-2d1751b10f34'} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:12 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 2147483648" returned: 0 in 1.474s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:12 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 Jul 06 12:23:12 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:13 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394" returned: 0 in 0.760s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.090s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "cinder-quobyte-70d61157-2c48-42bb-9e12-2d1751b10f34-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91d01ec-197c-4451-8296-ffc21aa65b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40063c7b-8112-4401-95d3-85c302573394', 'volume_size': 2}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0e9b9f-fb06-412b-86c7-f91a34fba1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-70d61157-2c48-42bb-9e12-2d1751b10f34-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Creating volume d69ab60b-77cf-493f-9ea9-9b93d2c3996f from snapshot 70d61157-2c48-42bb-9e12-2d1751b10f34 {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "cinder-quobyte-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:13 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Volume volume-40063c7b-8112-4401-95d3-85c302573394 (40063c7b-8112-4401-95d3-85c302573394): created successfully Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0e9b9f-fb06-412b-86c7-f91a34fba1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Flow 'volume_create_manager' (d0c8ee07-f19f-4c9c-91c4-abfb6910780f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] snapshot: 70d61157-2c48-42bb-9e12-2d1751b10f34, volume: d69ab60b-77cf-493f-9ea9-9b93d2c3996f, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:23:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-22129dba-5bb2-43f6-ba57-fc950cfbe067 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Created volume successfully. Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[086fd27d-d301-4aa5-9146-c8d3686be557]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:13 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 Jul 06 12:23:13 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:14 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34" returned: 0 in 1.303s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5315d45-14bf-478d-8552-b2ede2cece1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:23:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:23:14 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e477e6-2c2d-41e6-b732-3e5f47fae77f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:14 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d Jul 06 12:23:14 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Flow 'volume_create_manager' (1c12b0fb-76fe-4be5-ae73-1336363c611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df244b2a-a328-48f1-ac5e-8534e2afce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df244b2a-a328-48f1-ac5e-8534e2afce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1760530857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e5189b-4174-4643-be14-201ec949299d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50dec60b6f0e4d6e874e36a383b5dc88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:15Z,use_quota=True,user_id='382759d95cd44004b99ff89efa8ed9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd60f9d-faf4-4689-ab1f-3eed36318e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd60f9d-faf4-4689-ab1f-3eed36318e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e4ea63-fcb4-41db-af4e-6a68333ce414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e4ea63-fcb4-41db-af4e-6a68333ce414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e5189b-4174-4643-be14-201ec949299d', 'volume_name': 'volume-d5e5189b-4174-4643-be14-201ec949299d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f3d511-60cc-49c2-94f0-a720fdd600be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f3d511-60cc-49c2-94f0-a720fdd600be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54522560-294b-48a6-b6ea-b26bf4c78a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Volume d5e5189b-4174-4643-be14-201ec949299d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e5189b-4174-4643-be14-201ec949299d', 'volume_size': 1} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:15 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d" returned: 0 in 0.944s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:23:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:15 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f Jul 06 12:23:15 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:22 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" returned: 0 in 6.440s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f05a2a7-37ab-4194-b391-4930c6e394be]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:22 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d Jul 06 12:23:22 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:23 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d" returned: 0 in 1.023s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:23 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:23:23 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Converted 1024.00 MB image at 158.98 MB/s Jul 06 12:23:23 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f is being set with open permissions: ugo+rw Jul 06 12:23:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:23 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f Jul 06 12:23:23 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:24 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" returned: 0 in 0.735s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" released by "_copy_volume_from_snapshot" :: held 10.578s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-70d61157-2c48-42bb-9e12-2d1751b10f34-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" released by "_create_volume_from_snapshot" :: held 10.654s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.690s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.490s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Creating offline snapshot f062ac09-5206-4f34-a16f-7df407da7b1a of volume 40063c7b-8112-4401-95d3-85c302573394 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e13542-acd4-4b30-9ae4-bd297f08dadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f', 'volume_size': 1, 'snapshot_id': '70d61157-2c48-42bb-9e12-2d1751b10f34'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c339b7a3-2324-4a47-bf29-af41252449ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5796305f-f173-4bb9-a207-54ac89e11143]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:24 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Volume volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f (d69ab60b-77cf-493f-9ea9-9b93d2c3996f): created successfully Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c339b7a3-2324-4a47-bf29-af41252449ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Flow 'volume_create_manager' (ce3aa97c-70b2-4df9-a63c-d65153f94f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-635c2a5b-23e6-4190-940c-275fec99dc19 tempest-VolumeDependencyTests-1040373355 None] Created volume successfully. Jul 06 12:23:24 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 Jul 06 12:23:24 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "cinder-70d61157-2c48-42bb-9e12-2d1751b10f34-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-70d61157-2c48-42bb-9e12-2d1751b10f34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "cinder-quobyte-f5315d45-14bf-478d-8552-b2ede2cece1d" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-f5315d45-14bf-478d-8552-b2ede2cece1d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "cinder-quobyte-70d61157-2c48-42bb-9e12-2d1751b10f34" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-70d61157-2c48-42bb-9e12-2d1751b10f34" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Deleting offline snapshot 70d61157-2c48-42bb-9e12-2d1751b10f34 of volume f5315d45-14bf-478d-8552-b2ede2cece1d {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] snapshot_file for this snap is: volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1ccb59-3d1f-4347-90f4-4f9dd796089d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:24 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 Jul 06 12:23:24 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:24 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394" returned: 0 in 0.904s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a 2G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:25 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a 2G Jul 06 12:23:25 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:25 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34" returned: 0 in 0.903s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5315d45-14bf-478d-8552-b2ede2cece1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:25 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[07728a4f-0502-411a-8588-f4410c65c99e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:25 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d Jul 06 12:23:25 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:25 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a 2G" returned: 0 in 0.958s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40063c7b-8112-4401-95d3-85c302573394 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:25 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40063c7b-8112-4401-95d3-85c302573394 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a Jul 06 12:23:25 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:26 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d" returned: 0 in 0.882s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:26 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 Jul 06 12:23:26 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:26 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40063c7b-8112-4401-95d3-85c302573394 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a" returned: 0 in 0.782s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:26 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a is being set with open permissions: ugo+rw Jul 06 12:23:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:26 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a Jul 06 12:23:26 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:27 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34" returned: 0 in 0.859s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:27 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34 Jul 06 12:23:27 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:27 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a" returned: 0 in 0.692s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:27 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.info Jul 06 12:23:27 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:27 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d.70d61157-2c48-42bb-9e12-2d1751b10f34" returned: 0 in 0.700s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-70d61157-2c48-42bb-9e12-2d1751b10f34" released by "_delete_snapshot" :: held 3.479s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-f5315d45-14bf-478d-8552-b2ede2cece1d" released by "delete_snapshot" :: held 3.514s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Created reservations ['98497f80-dbcc-40e1-8ef8-d8f9743db6dc', 'd11e68d5-0115-4a74-b5c8-64d877589a1a', 'f81ceb19-12bf-4422-a85d-8d8b91d9fce4', 'bce7c983-6319-4e71-9345-26ea311af0a2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:28 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.info" returned: 0 in 0.701s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:28 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.info is being set with open permissions: ugo+rw Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Delete snapshot completed successfully. Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-58bf04da-61a6-42e6-98ad-1d8016e88ea8 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-70d61157-2c48-42bb-9e12-2d1751b10f34-delete_snapshot" released by "delete_snapshot" :: held 3.720s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:28 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.info Jul 06 12:23:28 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "cinder-f5315d45-14bf-478d-8552-b2ede2cece1d-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-f5315d45-14bf-478d-8552-b2ede2cece1d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "cinder-quobyte-f5315d45-14bf-478d-8552-b2ede2cece1d" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-f5315d45-14bf-478d-8552-b2ede2cece1d" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[59169ee2-3683-4b39-8fd2-0a720063879a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:28 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.info" returned: 0 in 0.814s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.982s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.582s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1760530857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e5189b-4174-4643-be14-201ec949299d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50dec60b6f0e4d6e874e36a383b5dc88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:15Z,use_quota=True,user_id='382759d95cd44004b99ff89efa8ed9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Creating volume d5e5189b-4174-4643-be14-201ec949299d {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:29 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:29 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d 1073741824 Jul 06 12:23:29 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:29 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d Jul 06 12:23:29 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6b671347-8ccf-4510-ad37-f1f2e7247603 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Create snapshot completed successfully Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Acquiring lock "cinder-f062ac09-5206-4f34-a16f-7df407da7b1a-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "cinder-f062ac09-5206-4f34-a16f-7df407da7b1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Acquiring lock "cinder-quobyte-40063c7b-8112-4401-95d3-85c302573394" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=91,cinder:UPDATE=96,cinder:DELETE=11,cinder:INSERT=27 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "cinder-quobyte-40063c7b-8112-4401-95d3-85c302573394" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Acquiring lock "cinder-quobyte-f062ac09-5206-4f34-a16f-7df407da7b1a" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "cinder-quobyte-f062ac09-5206-4f34-a16f-7df407da7b1a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Deleting offline snapshot f062ac09-5206-4f34-a16f-7df407da7b1a of volume 40063c7b-8112-4401-95d3-85c302573394 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:23:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] snapshot_file for this snap is: volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:23:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb688e9c-30f4-4285-b2e7-1229d0549ee1]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:30 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a Jul 06 12:23:30 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:30 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d" returned: 0 in 1.345s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:30 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d Jul 06 12:23:30 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:30 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d 1073741824" returned: 0 in 1.591s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:30 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d Jul 06 12:23:30 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:31 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f5315d45-14bf-478d-8552-b2ede2cece1d" returned: 0 in 1.010s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-f5315d45-14bf-478d-8552-b2ede2cece1d" released by "delete_volume" :: held 2.463s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:31 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a" returned: 0 in 1.356s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40063c7b-8112-4401-95d3-85c302573394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3013cd7e-46f4-4628-ad6b-97616a3e98af]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Created reservations ['2ef34aa5-10db-4470-a6d2-a01c8970c616', '541d6b7a-dc1a-4315-89da-c79a4b88bb22', '7285c422-a709-4102-b957-32d12de2a56a', '2d442a0a-24e0-4c84-a83b-ad4f193ce1a8'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:31 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:23:31 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:31 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 Jul 06 12:23:31 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:31 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d" returned: 0 in 1.173s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] <== create_volume: return (2843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.847s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54522560-294b-48a6-b6ea-b26bf4c78a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e5189b-4174-4643-be14-201ec949299d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4993fa-22a7-4fc5-b6aa-47058430b6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Volume volume-d5e5189b-4174-4643-be14-201ec949299d (d5e5189b-4174-4643-be14-201ec949299d): created successfully Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4993fa-22a7-4fc5-b6aa-47058430b6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Flow 'volume_create_manager' (1c12b0fb-76fe-4be5-ae73-1336363c611c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4ccbe045-4049-4401-b38d-b7f137099aa4 tempest-SnapshotDependencyTests-320380671 None] Created volume successfully. Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "cinder-d69ab60b-77cf-493f-9ea9-9b93d2c3996f-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-d69ab60b-77cf-493f-9ea9-9b93d2c3996f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "cinder-quobyte-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9bd37a-ac3e-4385-8757-11017201b65d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:32 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.908s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Deleted volume successfully. Jul 06 12:23:32 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-446fd1f9-b9de-4cce-9a92-8f32b3a8e1af tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-f5315d45-14bf-478d-8552-b2ede2cece1d-delete_volume" released by "delete_volume" :: held 3.822s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394" returned: 0 in 1.165s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:32 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f Jul 06 12:23:32 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:32 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a Jul 06 12:23:32 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:32 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:23:32 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] Creating offline snapshot c203ce4d-f791-4b9d-8230-fd05da87c39d of volume d5e5189b-4174-4643-be14-201ec949299d {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[66578633-7632-48ce-bd1b-59d35e3e942b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:33 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" returned: 0 in 1.175s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:33 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f Jul 06 12:23:33 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:33 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a" returned: 0 in 1.113s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:33 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a Jul 06 12:23:33 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:33 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d Jul 06 12:23:33 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:33 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.014s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:23:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:23:34 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d" returned: 0 in 1.134s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:34 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394.f062ac09-5206-4f34-a16f-7df407da7b1a" returned: 0 in 0.993s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:34 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d 1G Jul 06 12:23:34 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "cinder-quobyte-f062ac09-5206-4f34-a16f-7df407da7b1a" released by "_delete_snapshot" :: held 4.816s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:34 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" returned: 0 in 1.121s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "cinder-quobyte-40063c7b-8112-4401-95d3-85c302573394" released by "delete_snapshot" :: held 4.859s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-quobyte-d69ab60b-77cf-493f-9ea9-9b93d2c3996f" released by "delete_volume" :: held 2.373s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:34 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Created reservations ['cc9a6ccd-be41-4c95-a86e-c7decd5a6e54', 'd4c7f5ec-bc99-4614-9460-4ff9409406d3', '312cfe8e-dc17-4348-ae0c-bde9ada4ae13', 'a9e43c00-ee46-43b1-b68b-55fd1943907a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:34 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Created reservations ['7602c75a-fd7c-465e-9e67-04f14ce5a0d8', 'db5fc5f6-2cab-4319-b594-d0adf0cd9d4c', '8d61e8b3-8f8d-4897-8278-fb6486b0a72c', '5ff6aeb8-a4cd-4dde-b964-45a16a688c50'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:35 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:23:35 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Delete snapshot completed successfully. Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5ffa14d5-7ac9-40f4-a648-356979168ca9 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "cinder-f062ac09-5206-4f34-a16f-7df407da7b1a-delete_snapshot" released by "delete_snapshot" :: held 5.193s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Acquiring lock "cinder-40063c7b-8112-4401-95d3-85c302573394-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "cinder-40063c7b-8112-4401-95d3-85c302573394-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Acquiring lock "cinder-quobyte-40063c7b-8112-4401-95d3-85c302573394" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "cinder-quobyte-40063c7b-8112-4401-95d3-85c302573394" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[97692d4c-3aa3-4dbf-9de3-c2f7656706c2]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:35 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 Jul 06 12:23:35 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:35 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d 1G" returned: 0 in 1.238s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e5189b-4174-4643-be14-201ec949299d -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:36 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e5189b-4174-4643-be14-201ec949299d -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d Jul 06 12:23:36 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:36 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.192s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:36 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Deleted volume successfully. Jul 06 12:23:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4ff97050-0027-4b56-947f-37f9fb9b97c1 tempest-VolumeDependencyTests-1040373355 None] Lock "cinder-d69ab60b-77cf-493f-9ea9-9b93d2c3996f-delete_volume" released by "delete_volume" :: held 3.956s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:37 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394" returned: 0 in 1.577s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:37 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394 Jul 06 12:23:37 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:37 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e5189b-4174-4643-be14-201ec949299d -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d" returned: 0 in 1.491s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:37 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d is being set with open permissions: ugo+rw Jul 06 12:23:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:37 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d Jul 06 12:23:37 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:38 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-40063c7b-8112-4401-95d3-85c302573394" returned: 0 in 1.039s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "cinder-quobyte-40063c7b-8112-4401-95d3-85c302573394" released by "delete_volume" :: held 2.711s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Created reservations ['fd573c70-b00d-45f0-b516-bc2fd0807259', '10b0255a-bf02-43d9-a224-0133fb46ccd0', '5c3df956-bb1e-450f-a43d-36816c650f9f', '09205518-952e-47d5-ba56-7b97d6581aa6'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:23:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:38 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:23:38 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:38 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d" returned: 0 in 1.104s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:38 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.info Jul 06 12:23:38 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:39 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.184s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:39 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:23:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Deleted volume successfully. Jul 06 12:23:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cd6de9b5-0a3c-45a1-8cd7-ff1db72d7d35 tempest-VolumesSnapshotNegativeTestJSON-1923708704 None] Lock "cinder-40063c7b-8112-4401-95d3-85c302573394-delete_volume" released by "delete_volume" :: held 4.294s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:40 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.info" returned: 0 in 1.472s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:40 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.info is being set with open permissions: ugo+rw Jul 06 12:23:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:40 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.info Jul 06 12:23:40 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:41 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.info" returned: 0 in 1.445s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.050s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6703566d-846f-4c75-bf55-0f8169b73a62 tempest-SnapshotDependencyTests-320380671 None] Create snapshot completed successfully Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Flow 'volume_create_manager' (6d922a41-6804-45f2-a8fc-11b56549b426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05e0955-ecd2-49bc-9b02-3acc43baf0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05e0955-ecd2-49bc-9b02-3acc43baf0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5040208-68c7-4e23-a71a-cddd9efd9f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50dec60b6f0e4d6e874e36a383b5dc88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c203ce4d-f791-4b9d-8230-fd05da87c39d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:23:43Z,use_quota=True,user_id='382759d95cd44004b99ff89efa8ed9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b42fed-6eac-4580-80c7-188dee191ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b42fed-6eac-4580-80c7-188dee191ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028c3333-fe9c-4a80-952c-9bd350f92fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028c3333-fe9c-4a80-952c-9bd350f92fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e5040208-68c7-4e23-a71a-cddd9efd9f52', 'volume_name': 'volume-e5040208-68c7-4e23-a71a-cddd9efd9f52', 'volume_size': 1, 'snapshot_id': 'c203ce4d-f791-4b9d-8230-fd05da87c39d'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3420de5e-f910-4da8-8003-81f04d2953b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3420de5e-f910-4da8-8003-81f04d2953b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141ed9b7-68ed-40b7-a469-9c390f995335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:43 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Volume e5040208-68c7-4e23-a71a-cddd9efd9f52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e5040208-68c7-4e23-a71a-cddd9efd9f52', 'volume_size': 1, 'snapshot_id': 'c203ce4d-f791-4b9d-8230-fd05da87c39d'} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "cinder-quobyte-c203ce4d-f791-4b9d-8230-fd05da87c39d-e5040208-68c7-4e23-a71a-cddd9efd9f52" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-c203ce4d-f791-4b9d-8230-fd05da87c39d-e5040208-68c7-4e23-a71a-cddd9efd9f52" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Creating volume e5040208-68c7-4e23-a71a-cddd9efd9f52 from snapshot c203ce4d-f791-4b9d-8230-fd05da87c39d {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "cinder-quobyte-e5040208-68c7-4e23-a71a-cddd9efd9f52" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-e5040208-68c7-4e23-a71a-cddd9efd9f52" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] snapshot: c203ce4d-f791-4b9d-8230-fd05da87c39d, volume: e5040208-68c7-4e23-a71a-cddd9efd9f52, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[042b4b9a-2742-4ddf-829d-83b35ba14fce]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:43 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d Jul 06 12:23:43 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:44 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d" returned: 0 in 1.299s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5e5189b-4174-4643-be14-201ec949299d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:23:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:23:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[296d12ab-a7f3-4721-8dd1-0b578f3c3211]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:44 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d Jul 06 12:23:44 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:45 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d" returned: 0 in 1.196s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:45 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:23:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:45 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 Jul 06 12:23:45 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:53 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=56,cinder:UPDATE=60,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:23:53 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52" returned: 0 in 7.321s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d06fd5-7853-4f40-8455-cdfa20e83e43]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:53 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:23:53 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d Jul 06 12:23:53 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:54 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d" returned: 0 in 1.094s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:54 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d, size 1024.00 MB, duration 7.32 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:23:54 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Converted 1024.00 MB image at 139.85 MB/s Jul 06 12:23:54 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 is being set with open permissions: ugo+rw Jul 06 12:23:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:54 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 Jul 06 12:23:54 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:55 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52" returned: 0 in 0.851s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-e5040208-68c7-4e23-a71a-cddd9efd9f52" released by "_copy_volume_from_snapshot" :: held 11.858s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-c203ce4d-f791-4b9d-8230-fd05da87c39d-e5040208-68c7-4e23-a71a-cddd9efd9f52" released by "_create_volume_from_snapshot" :: held 11.889s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:23:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.905s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:23:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141ed9b7-68ed-40b7-a469-9c390f995335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5040208-68c7-4e23-a71a-cddd9efd9f52', 'volume_size': 1, 'snapshot_id': 'c203ce4d-f791-4b9d-8230-fd05da87c39d'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1524fb7-1359-4a4a-a95c-5912cc73f267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:23:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Volume volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 (e5040208-68c7-4e23-a71a-cddd9efd9f52): created successfully Jul 06 12:23:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1524fb7-1359-4a4a-a95c-5912cc73f267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:23:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Flow 'volume_create_manager' (6d922a41-6804-45f2-a8fc-11b56549b426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:23:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1e2f2824-f461-45a0-9d68-a4b9b099022b tempest-SnapshotDependencyTests-320380671 None] Created volume successfully. Jul 06 12:23:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "cinder-c203ce4d-f791-4b9d-8230-fd05da87c39d-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-c203ce4d-f791-4b9d-8230-fd05da87c39d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "cinder-quobyte-d5e5189b-4174-4643-be14-201ec949299d" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-d5e5189b-4174-4643-be14-201ec949299d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "cinder-quobyte-c203ce4d-f791-4b9d-8230-fd05da87c39d" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:23:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-c203ce4d-f791-4b9d-8230-fd05da87c39d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:23:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Deleting offline snapshot c203ce4d-f791-4b9d-8230-fd05da87c39d of volume d5e5189b-4174-4643-be14-201ec949299d {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:23:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] snapshot_file for this snap is: volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:23:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3d1cf0-73e1-4db7-add3-7bb102050d55]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:56 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d Jul 06 12:23:56 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:57 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d" returned: 0 in 1.102s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5e5189b-4174-4643-be14-201ec949299d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:23:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f47fec1-29be-4204-af13-0fbcd9031f97]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:23:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:57 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d Jul 06 12:23:57 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:58 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d" returned: 0 in 0.859s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:58 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d Jul 06 12:23:58 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:23:59 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 06 12:23:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d" returned: 0 in 0.816s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:23:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:23:59 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d Jul 06 12:23:59 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:00 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d.c203ce4d-f791-4b9d-8230-fd05da87c39d" returned: 0 in 1.093s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-c203ce4d-f791-4b9d-8230-fd05da87c39d" released by "_delete_snapshot" :: held 4.044s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-d5e5189b-4174-4643-be14-201ec949299d" released by "delete_snapshot" :: held 4.077s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:00 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Created reservations ['74f62fd8-b1e2-464e-b6e8-cd3ed2736306', '943a8111-a5e0-4c28-9b9a-01940047b1ec', 'd570f527-ad73-453c-998a-40b4f26ae081', '69367845-addc-4eaa-8491-01a5242a57e1'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Delete snapshot completed successfully. Jul 06 12:24:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f0ba6b9b-5817-42a9-8cea-b94106e9e2cf tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-c203ce4d-f791-4b9d-8230-fd05da87c39d-delete_snapshot" released by "delete_snapshot" :: held 4.311s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "cinder-d5e5189b-4174-4643-be14-201ec949299d-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-d5e5189b-4174-4643-be14-201ec949299d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "cinder-quobyte-d5e5189b-4174-4643-be14-201ec949299d" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-d5e5189b-4174-4643-be14-201ec949299d" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[892575b4-8f1c-45f0-b734-eb3c769ccd45]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:01 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d Jul 06 12:24:01 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:02 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d" returned: 0 in 1.031s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:02 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d Jul 06 12:24:02 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Flow 'volume_create_manager' (d87f9706-1d2f-42cd-a916-8054fbad0569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d18b82-b5a6-4e0a-b5c5-4724857abc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d18b82-b5a6-4e0a-b5c5-4724857abc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1121752420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c6eb74-2e19-4ffd-a333-34f193242252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bccd738c6944ce946f9903cae833c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:03Z,use_quota=True,user_id='2cbd8cc0990d4821837dc77bd62fb401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cb029c-f73e-4e1c-92f4-5c4ef79de61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03cb029c-f73e-4e1c-92f4-5c4ef79de61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1942a824-3294-48ca-ac19-ded98e23f68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1942a824-3294-48ca-ac19-ded98e23f68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c6eb74-2e19-4ffd-a333-34f193242252', 'volume_name': 'volume-a4c6eb74-2e19-4ffd-a333-34f193242252', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c265e9b3-9784-401d-8c68-bad77e877a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c265e9b3-9784-401d-8c68-bad77e877a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47904788-bc0b-4f3f-bb59-509fccf024c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:03 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Volume a4c6eb74-2e19-4ffd-a333-34f193242252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c6eb74-2e19-4ffd-a333-34f193242252', 'volume_size': 1} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1121752420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c6eb74-2e19-4ffd-a333-34f193242252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bccd738c6944ce946f9903cae833c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:03Z,use_quota=True,user_id='2cbd8cc0990d4821837dc77bd62fb401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Creating volume a4c6eb74-2e19-4ffd-a333-34f193242252 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:24:03 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:03 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252 1073741824 Jul 06 12:24:03 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:03 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d5e5189b-4174-4643-be14-201ec949299d" returned: 0 in 0.963s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-d5e5189b-4174-4643-be14-201ec949299d" released by "delete_volume" :: held 2.103s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Created reservations ['3cbf7194-1646-41d6-b6b6-d735181b4e1d', 'b501c507-229c-4186-b43e-6cfc05bf9464', '49b2cd17-d58a-46df-a8d1-389cfcb5d508', 'f33fc973-6faa-477f-9e0c-68dce73a1b61'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:04 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:24:04 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:04 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252 1073741824" returned: 0 in 1.171s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:04 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252 Jul 06 12:24:04 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:04 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.866s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:04 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Deleted volume successfully. Jul 06 12:24:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bb4af3fd-2b5b-4030-b25a-ec24cef9c735 tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-d5e5189b-4174-4643-be14-201ec949299d-delete_volume" released by "delete_volume" :: held 3.346s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "cinder-e5040208-68c7-4e23-a71a-cddd9efd9f52-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-e5040208-68c7-4e23-a71a-cddd9efd9f52-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "cinder-quobyte-e5040208-68c7-4e23-a71a-cddd9efd9f52" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-e5040208-68c7-4e23-a71a-cddd9efd9f52" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda988c6-372a-4cfa-86f1-3fb556f6d4ad]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:05 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252" returned: 0 in 0.939s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47904788-bc0b-4f3f-bb59-509fccf024c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c6eb74-2e19-4ffd-a333-34f193242252', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0624984c-3a3d-4904-a449-ce7b6f3f4ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:05 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 Jul 06 12:24:05 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Volume volume-a4c6eb74-2e19-4ffd-a333-34f193242252 (a4c6eb74-2e19-4ffd-a333-34f193242252): created successfully Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0624984c-3a3d-4904-a449-ce7b6f3f4ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Flow 'volume_create_manager' (d87f9706-1d2f-42cd-a916-8054fbad0569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7899a2bb-016f-4877-8d61-78602ee7bdd7 tempest-AttachVolumeNegativeTest-428349029 None] Created volume successfully. Jul 06 12:24:06 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52" returned: 0 in 0.979s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:06 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52 Jul 06 12:24:06 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5040208-68c7-4e23-a71a-cddd9efd9f52" returned: 0 in 0.920s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:07 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-quobyte-e5040208-68c7-4e23-a71a-cddd9efd9f52" released by "delete_volume" :: held 1.978s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:07 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Created reservations ['2050997e-b27a-45eb-9444-934a600f0606', '4eba7844-2b86-4a96-9c23-fb7ead0c7f63', 'eb53380c-d681-4ecc-97cf-709fad407e52', 'a735f5d3-7c6d-448f-80ef-dc67bc7e15c4'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:07 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:24:07 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:08 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.882s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:08 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Deleted volume successfully. Jul 06 12:24:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9aaeb29d-adf5-49a7-956c-3d8f9778c4f5 tempest-SnapshotDependencyTests-320380671 None] Lock "cinder-e5040208-68c7-4e23-a71a-cddd9efd9f52-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-8e8cf4cd-e518-48d7-bb2d-cc9a6f62a114 req-d848a076-583a-4d6c-8385-bea91edccc07 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-8e8cf4cd-e518-48d7-bb2d-cc9a6f62a114 req-d848a076-583a-4d6c-8385-bea91edccc07 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb28ac7-d520-464b-82d6-c998e8be4fdd]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-8e8cf4cd-e518-48d7-bb2d-cc9a6f62a114 req-d848a076-583a-4d6c-8385-bea91edccc07 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:09 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252 Jul 06 12:24:09 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:10 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-8e8cf4cd-e518-48d7-bb2d-cc9a6f62a114 req-d848a076-583a-4d6c-8385-bea91edccc07 tempest-AttachVolumeNegativeTest-428349029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252" returned: 0 in 1.050s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-8e8cf4cd-e518-48d7-bb2d-cc9a6f62a114 req-d848a076-583a-4d6c-8385-bea91edccc07 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.081s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-8e8cf4cd-e518-48d7-bb2d-cc9a6f62a114 req-d848a076-583a-4d6c-8385-bea91edccc07 tempest-AttachVolumeNegativeTest-428349029 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-a4c6eb74-2e19-4ffd-a333-34f193242252', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd139761e-7ca7-4945-bc0d-29e658fec904', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:24:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-8e8cf4cd-e518-48d7-bb2d-cc9a6f62a114 req-d848a076-583a-4d6c-8385-bea91edccc07 tempest-AttachVolumeNegativeTest-428349029 None] attachment_update completed successfully. Jul 06 12:24:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-2743ce4f-3e65-4ae5-b383-e44e7c88c678 req-f29a2488-2f0c-4c33-901f-5d5636358581 tempest-AttachVolumeNegativeTest-428349029 None] Terminate volume connection completed successfully. Jul 06 12:24:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-2743ce4f-3e65-4ae5-b383-e44e7c88c678 req-f29a2488-2f0c-4c33-901f-5d5636358581 tempest-AttachVolumeNegativeTest-428349029 None] Deleting attachment d139761e-7ca7-4945-bc0d-29e658fec904. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:24:27 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:24:27 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=30,cinder:SELECT=23,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "cinder-a4c6eb74-2e19-4ffd-a333-34f193242252-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-a4c6eb74-2e19-4ffd-a333-34f193242252-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "cinder-quobyte-a4c6eb74-2e19-4ffd-a333-34f193242252" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-quobyte-a4c6eb74-2e19-4ffd-a333-34f193242252" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b31bd0-c2fd-4478-9551-ad621a7d70b2]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:29 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252 Jul 06 12:24:29 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:30 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252" returned: 0 in 1.043s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:30 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252 Jul 06 12:24:30 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:31 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a4c6eb74-2e19-4ffd-a333-34f193242252" returned: 0 in 0.731s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-quobyte-a4c6eb74-2e19-4ffd-a333-34f193242252" released by "delete_volume" :: held 1.921s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Created reservations ['3efc2e8d-3e65-4800-bd7f-d3fe2593c1e9', '381a084a-ac8f-4953-aefc-f0e32d47f8b1', 'f304dca5-1f37-43a4-9118-e9210c762625', '8600bc64-0a2e-49bc-a691-47cf8cff116a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:31 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:24:31 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "cinder-dd2d0baa-a780-4cdb-a8ea-be254ff20de9-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-dd2d0baa-a780-4cdb-a8ea-be254ff20de9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "cinder-quobyte-dd2d0baa-a780-4cdb-a8ea-be254ff20de9" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-quobyte-dd2d0baa-a780-4cdb-a8ea-be254ff20de9" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e018c6-da02-4ff0-ae40-dbed13c69a12]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:31 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 Jul 06 12:24:31 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:32 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.811s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Deleted volume successfully. Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9eb04d81-d8a8-4411-b73a-d29cdc5268fb tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-a4c6eb74-2e19-4ffd-a333-34f193242252-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:32 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9" returned: 0 in 0.868s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:32 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9 Jul 06 12:24:32 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:32 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:24:32 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:33 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-dd2d0baa-a780-4cdb-a8ea-be254ff20de9" returned: 0 in 0.748s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-quobyte-dd2d0baa-a780-4cdb-a8ea-be254ff20de9" released by "delete_volume" :: held 1.683s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Created reservations ['f7976fac-3a56-4c8c-817e-c1badd3ad1d7', '04a17f01-45bc-4e67-ab8a-58f9dfa122f1', 'f646f10e-247e-41a4-b538-81e95a75ab18', 'e18e69af-7f15-4e5c-be39-f097e8ac80e9'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:33 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:24:33 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:33 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.933s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:24:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:24:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "cinder-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "cinder-quobyte-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-quobyte-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569" acquired by "delete_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[30379e00-fc42-4955-95d9-586cfd3b3fec]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:34 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 Jul 06 12:24:34 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:34 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.158s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Deleted volume successfully. Jul 06 12:24:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a46a72db-2f46-4f26-ba54-064bd4e2ee74 tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-dd2d0baa-a780-4cdb-a8ea-be254ff20de9-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:35 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569" returned: 0 in 1.090s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:35 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569 Jul 06 12:24:35 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:36 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569" returned: 0 in 0.671s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-quobyte-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569" released by "delete_volume" :: held 1.850s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:36 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Created reservations ['eca65489-f494-435a-b4e8-d4a7be9e34cd', '819f1c46-424c-44c1-9685-ac08312535ba', 'ba0bd676-ba8f-482d-a0cf-720fb7dcc262', 'f61b99d8-5e52-4458-85dc-5134693a53a0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:36 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:24:36 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:37 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.787s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Deleted volume successfully. Jul 06 12:24:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a5133807-4bfe-4cfb-8f56-c6a839a29dd8 tempest-AttachVolumeNegativeTest-428349029 None] Lock "cinder-7c93ae87-1d4f-4dc9-8e7d-1464b5c85569-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Flow 'volume_create_manager' (e5004852-a1d4-4a55-b073-5ba42a0ce4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16c143c-8011-4897-8c1c-3ea5ebe568c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16c143c-8011-4897-8c1c-3ea5ebe568c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-384731541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69629e7a-966b-468e-a4a1-d271bfd3f4ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ecc30009b7945df810f228076c0a538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:44Z,use_quota=True,user_id='89c65102cffb48a181b95286955e2357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3b3e59-890a-48d3-ba8a-038f6d276c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3b3e59-890a-48d3-ba8a-038f6d276c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1575f68-f2aa-43be-adb7-f7343c6f1cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1575f68-f2aa-43be-adb7-f7343c6f1cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69629e7a-966b-468e-a4a1-d271bfd3f4ca', 'volume_name': 'volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd36ac16-cfc7-4361-8bab-83642abcc4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd36ac16-cfc7-4361-8bab-83642abcc4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652fbd41-961a-41fa-855f-514c26c78053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:44 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Volume 69629e7a-966b-468e-a4a1-d271bfd3f4ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca', 'volume_size': 1} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-384731541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69629e7a-966b-468e-a4a1-d271bfd3f4ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ecc30009b7945df810f228076c0a538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:44Z,use_quota=True,user_id='89c65102cffb48a181b95286955e2357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Creating volume 69629e7a-966b-468e-a4a1-d271bfd3f4ca {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:24:44 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:24:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:44 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca 1073741824 Jul 06 12:24:44 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:45 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca 1073741824" returned: 0 in 1.018s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:45 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca Jul 06 12:24:45 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:46 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca" returned: 0 in 0.756s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652fbd41-961a-41fa-855f-514c26c78053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f366ae1-a70d-42a2-b940-f1cd3df2ca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:46 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Volume volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca (69629e7a-966b-468e-a4a1-d271bfd3f4ca): created successfully Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f366ae1-a70d-42a2-b940-f1cd3df2ca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Flow 'volume_create_manager' (e5004852-a1d4-4a55-b073-5ba42a0ce4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-45efde9b-f4d7-48e5-a73a-433517cf3845 req-2b621e3a-c6e2-43cf-9628-065939fe4c24 tempest-VolumesGetTestJSON-421996429 None] Created volume successfully. Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Acquiring lock "cinder-69629e7a-966b-468e-a4a1-d271bfd3f4ca-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Lock "cinder-69629e7a-966b-468e-a4a1-d271bfd3f4ca-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Acquiring lock "cinder-quobyte-69629e7a-966b-468e-a4a1-d271bfd3f4ca" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Lock "cinder-quobyte-69629e7a-966b-468e-a4a1-d271bfd3f4ca" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f81834-c877-4437-988f-28249350b919]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:46 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca Jul 06 12:24:46 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:47 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca" returned: 0 in 0.782s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:47 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca Jul 06 12:24:47 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:48 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-69629e7a-966b-468e-a4a1-d271bfd3f4ca" returned: 0 in 0.698s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Lock "cinder-quobyte-69629e7a-966b-468e-a4a1-d271bfd3f4ca" released by "delete_volume" :: held 1.530s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:48 devstack cinder-volume[86561]: DEBUG cinder.quota [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Created reservations ['d656d01e-6ade-4a9c-bfd3-53d91bbbf41c', '7347fb6a-af3b-401d-a344-3407ab67c5e1', 'd146407f-fa15-46e1-9f69-a02ee23eeafb', '573e5fc5-08d8-47e8-bfb3-8ca802c56a94'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:24:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:48 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:24:48 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:49 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.684s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:49 devstack cinder-volume[86561]: DEBUG cinder.manager [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:24:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Deleted volume successfully. Jul 06 12:24:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-3ab245d7-6fb2-4a59-9f5e-6b4cec7a6c48 req-98be820a-fde7-447f-bd21-82547c17d285 tempest-VolumesGetTestJSON-421996429 None] Lock "cinder-69629e7a-966b-468e-a4a1-d271bfd3f4ca-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:24:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4559ef8f-9e92-4000-b862-00b1ed1361e8 tempest-GroupSnapshotsTest-352563802 None] Group tempest-GroupSnapshotsTest-Group-1269268224: creating Jul 06 12:24:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4559ef8f-9e92-4000-b862-00b1ed1361e8 tempest-GroupSnapshotsTest-352563802 None] Group tempest-GroupSnapshotsTest-Group-1269268224: created successfully Jul 06 12:24:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4559ef8f-9e92-4000-b862-00b1ed1361e8 tempest-GroupSnapshotsTest-352563802 None] Create group completed successfully. Jul 06 12:24:54 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:24:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Flow 'volume_create_manager' (9b33ca39-1ff3-4b67-aa06-cc27f2e348f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1286c46d-8c48-4515-a1dd-38b8d291fb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1286c46d-8c48-4515-a1dd-38b8d291fb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-994006176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe87ed77-2d0a-48e9-bccc-4ebf0fbdc979,host='devstack@QuobyteHD#QuobyteHD',id=d4bac558-d2c4-4050-a508-b18664c85a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c9e518665b404f8ea2af14d979e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:55Z,use_quota=True,user_id='ca0ebc5358ff46ed8283940bff21420a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da4a3354-fd3d-47da-98bc-c0050ffd215a),volume_type_id=da4a3354-fd3d-47da-98bc-c0050ffd215a)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6189fde0-3f63-43a7-afea-0069d11bc72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6189fde0-3f63-43a7-afea-0069d11bc72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0bcbfc-5ecd-46bb-b132-955bb7b1f547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0bcbfc-5ecd-46bb-b132-955bb7b1f547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4bac558-d2c4-4050-a508-b18664c85a8a', 'volume_name': 'volume-d4bac558-d2c4-4050-a508-b18664c85a8a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf2336d-1d71-4810-9be9-fc0df2f10c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf2336d-1d71-4810-9be9-fc0df2f10c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251bed19-be0b-4295-b246-ffec0edac137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Volume d4bac558-d2c4-4050-a508-b18664c85a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4bac558-d2c4-4050-a508-b18664c85a8a', 'volume_size': 1} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe87ed77-2d0a-48e9-bccc-4ebf0fbdc979,created_at=2026-07-06T10:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-994006176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe87ed77-2d0a-48e9-bccc-4ebf0fbdc979,host='devstack@QuobyteHD#QuobyteHD',id=d4bac558-d2c4-4050-a508-b18664c85a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c9e518665b404f8ea2af14d979e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:55Z,use_quota=True,user_id='ca0ebc5358ff46ed8283940bff21420a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da4a3354-fd3d-47da-98bc-c0050ffd215a),volume_type_id=da4a3354-fd3d-47da-98bc-c0050ffd215a)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Creating volume d4bac558-d2c4-4050-a508-b18664c85a8a {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:24:55 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:24:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:55 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a 1073741824 Jul 06 12:24:55 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:56 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a 1073741824" returned: 0 in 1.003s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:56 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a Jul 06 12:24:56 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Flow 'volume_create_manager' (247bbe8c-2313-4628-bde2-bfe41fd3c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed187bc2-7d16-40eb-91dd-e3916c296ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed187bc2-7d16-40eb-91dd-e3916c296ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-690596890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309a110f-57e2-435b-8859-8fd7884c837e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5612bd6887e497983961c6513ad0386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:56Z,use_quota=True,user_id='5c1a2c4d451746dc9323fcefff9814be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da953d8-0916-486a-95a1-4d21eeef9f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da953d8-0916-486a-95a1-4d21eeef9f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10561fc8-9c91-4b27-85bf-567f82d09a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10561fc8-9c91-4b27-85bf-567f82d09a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309a110f-57e2-435b-8859-8fd7884c837e', 'volume_name': 'volume-309a110f-57e2-435b-8859-8fd7884c837e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00da914f-5ccc-43f6-b5bb-7617d61d4ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00da914f-5ccc-43f6-b5bb-7617d61d4ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2be753-b0e9-4786-9c51-63cb2dc2cb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Volume 309a110f-57e2-435b-8859-8fd7884c837e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309a110f-57e2-435b-8859-8fd7884c837e', 'volume_size': 1} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:56 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a" returned: 0 in 0.752s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-690596890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309a110f-57e2-435b-8859-8fd7884c837e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5612bd6887e497983961c6513ad0386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:24:56Z,use_quota=True,user_id='5c1a2c4d451746dc9323fcefff9814be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Creating volume 309a110f-57e2-435b-8859-8fd7884c837e {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:24:56 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:56 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e 1073741824 Jul 06 12:24:56 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251bed19-be0b-4295-b246-ffec0edac137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4bac558-d2c4-4050-a508-b18664c85a8a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878a7fe8-35bb-4eac-a81b-3f910d9ec673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Volume volume-d4bac558-d2c4-4050-a508-b18664c85a8a (d4bac558-d2c4-4050-a508-b18664c85a8a): created successfully Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878a7fe8-35bb-4eac-a81b-3f910d9ec673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Flow 'volume_create_manager' (9b33ca39-1ff3-4b67-aa06-cc27f2e348f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:56 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9a484207-2b5a-41d3-843a-7d9bd76022d5 tempest-GroupSnapshotsTest-352563802 None] Created volume successfully. Jul 06 12:24:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] GroupSnapshot 47afe21a-280c-4027-9a1b-3c6588f044c1: creating. Jul 06 12:24:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] Group snapshot 47afe21a-280c-4027-9a1b-3c6588f044c1: creating. {{(pid=86561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:24:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:24:57 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e 1073741824" returned: 0 in 0.961s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:57 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e Jul 06 12:24:57 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:58 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e" returned: 0 in 0.694s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:24:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:24:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.846s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2be753-b0e9-4786-9c51-63cb2dc2cb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309a110f-57e2-435b-8859-8fd7884c837e', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512a5057-7a45-4e6d-8a3a-46a775330627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] Creating offline snapshot 61ef9965-279a-430c-a1d3-d90bf2cafba0 of volume d4bac558-d2c4-4050-a508-b18664c85a8a {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:24:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Volume volume-309a110f-57e2-435b-8859-8fd7884c837e (309a110f-57e2-435b-8859-8fd7884c837e): created successfully Jul 06 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512a5057-7a45-4e6d-8a3a-46a775330627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:24:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Flow 'volume_create_manager' (247bbe8c-2313-4628-bde2-bfe41fd3c73c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:24:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e038b8-8e7d-409e-860a-09d58bab5856]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:24:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4b6d74f6-c0b8-468a-b3b7-33ec54b14770 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Created volume successfully. Jul 06 12:24:58 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a Jul 06 12:24:58 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:24:59 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Jul 06 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a" returned: 0 in 0.825s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:24:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:24:59 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 1G Jul 06 12:24:59 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:00 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 1G" returned: 0 in 0.860s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bac558-d2c4-4050-a508-b18664c85a8a -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:00 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bac558-d2c4-4050-a508-b18664c85a8a -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 Jul 06 12:25:00 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:01 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bac558-d2c4-4050-a508-b18664c85a8a -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0" returned: 0 in 0.801s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:01 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:01 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 Jul 06 12:25:01 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:01 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0" returned: 0 in 0.783s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:02 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.info Jul 06 12:25:02 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-9b4aa5da-3b29-43a6-97c5-9934982eb063 req-1810760a-d6bf-40f9-8b76-88fdcfa6c8e2 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:02 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.info" returned: 0 in 0.796s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:02 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:02 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.info Jul 06 12:25:02 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:03 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.info" returned: 0 in 0.750s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.948s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-9b4aa5da-3b29-43a6-97c5-9934982eb063 req-1810760a-d6bf-40f9-8b76-88fdcfa6c8e2 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.055s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe04f7e-a3d7-4a7d-a91b-cd45d4434bcf]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-9b4aa5da-3b29-43a6-97c5-9934982eb063 req-1810760a-d6bf-40f9-8b76-88fdcfa6c8e2 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9397acdf-e0fc-46f5-b6ba-b2c42c3565b5 tempest-GroupSnapshotsTest-352563802 None] group_snapshot 47afe21a-280c-4027-9a1b-3c6588f044c1: created successfully Jul 06 12:25:03 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e Jul 06 12:25:03 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:04 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-9b4aa5da-3b29-43a6-97c5-9934982eb063 req-1810760a-d6bf-40f9-8b76-88fdcfa6c8e2 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e" returned: 0 in 0.878s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-9b4aa5da-3b29-43a6-97c5-9934982eb063 req-1810760a-d6bf-40f9-8b76-88fdcfa6c8e2 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.914s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-9b4aa5da-3b29-43a6-97c5-9934982eb063 req-1810760a-d6bf-40f9-8b76-88fdcfa6c8e2 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-309a110f-57e2-435b-8859-8fd7884c837e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6016c7ef-f727-44bf-a7fd-9b27620288eb', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:25:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-9b4aa5da-3b29-43a6-97c5-9934982eb063 req-1810760a-d6bf-40f9-8b76-88fdcfa6c8e2 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] attachment_update completed successfully. Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-61ef9965-279a-430c-a1d3-d90bf2cafba0-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-61ef9965-279a-430c-a1d3-d90bf2cafba0-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Creating volume 6d787cd7-a81a-4a5e-81ee-f01ac7a0963a from snapshot 61ef9965-279a-430c-a1d3-d90bf2cafba0 {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] snapshot: 61ef9965-279a-430c-a1d3-d90bf2cafba0, volume: 6d787cd7-a81a-4a5e-81ee-f01ac7a0963a, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84b8e97-a610-4b54-932e-ba5ef4b6a47f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:05 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 Jul 06 12:25:05 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:06 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0" returned: 0 in 0.869s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4bac558-d2c4-4050-a508-b18664c85a8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:25:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:25:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd60f1-bf6c-45e1-a131-510fd9d0e0e2]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:06 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a Jul 06 12:25:06 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:07 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a" returned: 0 in 0.828s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:07 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:25:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:07 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a Jul 06 12:25:07 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:13 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" returned: 0 in 5.923s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[60407d73-f39c-4674-8aa1-7422170d05d4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:13 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a Jul 06 12:25:13 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-826288e0-bd78-4f99-bd01-71ef79bf3cfb req-7afcf812-7d7e-429a-9339-4b0cf4679af9 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Terminate volume connection completed successfully. Jul 06 12:25:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-826288e0-bd78-4f99-bd01-71ef79bf3cfb req-7afcf812-7d7e-429a-9339-4b0cf4679af9 tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Deleting attachment 6016c7ef-f727-44bf-a7fd-9b27620288eb. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:25:14 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a" returned: 0 in 1.126s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:14 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:25:14 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Converted 1024.00 MB image at 172.85 MB/s Jul 06 12:25:14 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:14 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a Jul 06 12:25:14 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:15 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" returned: 0 in 0.744s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" released by "_copy_volume_from_snapshot" :: held 9.607s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-61ef9965-279a-430c-a1d3-d90bf2cafba0-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" released by "_create_volume_from_snapshot" :: held 9.648s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.670s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4d42eec1-b7cb-42f3-a56d-bb6c2ab20a7a tempest-GroupSnapshotsTest-352563802 None] Create group from source-snapshot-47afe21a-280c-4027-9a1b-3c6588f044c1 completed successfully. Jul 06 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Acquiring lock "cinder-309a110f-57e2-435b-8859-8fd7884c837e-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "cinder-309a110f-57e2-435b-8859-8fd7884c837e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Acquiring lock "cinder-quobyte-309a110f-57e2-435b-8859-8fd7884c837e" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "cinder-quobyte-309a110f-57e2-435b-8859-8fd7884c837e" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:16 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced2f120-8cfb-403f-964f-0ad7bb96c9db]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:16 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e Jul 06 12:25:16 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:16 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc935d78-afef-4e34-aea5-ac99fc06049d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:16 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a Jul 06 12:25:16 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:17 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e" returned: 0 in 0.942s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:17 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e Jul 06 12:25:17 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:17 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" returned: 0 in 0.851s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:17 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a Jul 06 12:25:17 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:18 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-309a110f-57e2-435b-8859-8fd7884c837e" returned: 0 in 0.842s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "cinder-quobyte-309a110f-57e2-435b-8859-8fd7884c837e" released by "delete_volume" :: held 1.835s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:18 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" returned: 0 in 0.834s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-6d787cd7-a81a-4a5e-81ee-f01ac7a0963a" released by "delete_volume" :: held 1.741s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Created reservations ['c0a9981f-7d56-45ec-8417-f907a97c0a00', '749f04a2-0163-4179-a890-d89a95bf925f', '776455ff-160b-4088-af14-e7a25d4827c8', '13cc76a9-4b0a-4010-a557-1ebe0d48b756'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Created reservations ['aef4f590-5a8c-4c79-9daf-e7fd49efc8b2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:18 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:25:18 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:18 devstack cinder-volume[86561]: WARNING cinder.quota [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1710750981 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1710750981, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:18 devstack cinder-volume[86561]: WARNING cinder.quota [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1710750981 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1710750981, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Created reservations ['54b59224-0126-490d-9bfe-7b8f3716740e', '2da5ea3b-73fd-47a6-ae43-e2229814186a', 'ab814b59-0b04-44c3-a891-def9641d9382', '966db4e3-dac8-4dbd-bc69-5ca8884fca37'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:18 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:25:18 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] group_snapshot 47afe21a-280c-4027-9a1b-3c6588f044c1: deleting Jul 06 12:25:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] group_snapshot 47afe21a-280c-4027-9a1b-3c6588f044c1: deleting {{(pid=86561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-d4bac558-d2c4-4050-a508-b18664c85a8a" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-d4bac558-d2c4-4050-a508-b18664c85a8a" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-61ef9965-279a-430c-a1d3-d90bf2cafba0" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-61ef9965-279a-430c-a1d3-d90bf2cafba0" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Deleting offline snapshot 61ef9965-279a-430c-a1d3-d90bf2cafba0 of volume d4bac558-d2c4-4050-a508-b18664c85a8a {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] snapshot_file for this snap is: volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1209e788-9f17-4192-8342-181be84d1ee0]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:19 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 Jul 06 12:25:19 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:19 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.390s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Deleted volume successfully. Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-382224a4-a53c-476b-81dc-d15cc503c9be tempest-TestServerVolumeAttachScenarioOldVersion-1514617529 None] Lock "cinder-309a110f-57e2-435b-8859-8fd7884c837e-delete_volume" released by "delete_volume" :: held 3.587s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:19 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.254s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:19 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-031eb7be-5448-4b95-9083-e4b0d7fe067c tempest-GroupSnapshotsTest-352563802 None] Delete group completed successfully. Jul 06 12:25:20 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0" returned: 0 in 1.039s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4bac558-d2c4-4050-a508-b18664c85a8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:25:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9390e6c8-d3f5-4512-813d-79be8e3a1f5e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:20 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a Jul 06 12:25:20 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:21 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a" returned: 0 in 1.119s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:21 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 Jul 06 12:25:21 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:22 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0" returned: 0 in 0.911s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:22 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0 Jul 06 12:25:22 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:22 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a.61ef9965-279a-430c-a1d3-d90bf2cafba0" returned: 0 in 0.663s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-61ef9965-279a-430c-a1d3-d90bf2cafba0" released by "_delete_snapshot" :: held 3.875s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-d4bac558-d2c4-4050-a508-b18664c85a8a" released by "delete_snapshot" :: held 3.930s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:23 devstack cinder-volume[86561]: WARNING cinder.quota [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1710750981 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1710750981, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:23 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] Created reservations ['48b92079-2b4e-4c11-bd66-97ba940416fe', 'd322268a-7c06-4cf1-9861-983a3b63e816', 'a6acacbc-1d12-4fe2-a069-ae7a549317e4', 'a4e4f6ee-dccb-4704-bc99-7de70e0c41c6'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-332c0948-090e-425e-b506-2e45156e28bc tempest-GroupSnapshotsTest-352563802 None] group_snapshot 47afe21a-280c-4027-9a1b-3c6588f044c1: deleted successfully Jul 06 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-d4bac558-d2c4-4050-a508-b18664c85a8a" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-d4bac558-d2c4-4050-a508-b18664c85a8a" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[24284328-4950-4316-9d04-f79f5f11bfff]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:24 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a Jul 06 12:25:24 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:24 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a" returned: 0 in 0.835s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:24 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a Jul 06 12:25:24 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:25 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d4bac558-d2c4-4050-a508-b18664c85a8a" returned: 0 in 0.700s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-d4bac558-d2c4-4050-a508-b18664c85a8a" released by "delete_volume" :: held 1.605s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Created reservations ['a9561a35-41e5-4a0d-86dd-8a740e2ab8c6'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:25 devstack cinder-volume[86561]: WARNING cinder.db.api [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1710750981'] Jul 06 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Created reservations ['40f408c6-1954-498d-b525-fab8e9eca208', '1029e194-b2a5-4b4a-b24b-152b144faf49', '802aee6e-aeae-49f9-b55f-dcf619f5d135', '924797e3-b97b-4de7-8a6a-3877039f2e62'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:25 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:25:25 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:26 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.730s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8244efaa-15dc-45c9-8efd-41b3c629dca0 tempest-GroupSnapshotsTest-352563802 None] Delete group completed successfully. Jul 06 12:25:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fdc3d21d-a3a5-453a-815f-432d9e33459e tempest-GroupSnapshotsTest-352563802 None] Group tempest-GroupSnapshotsTest-Group-738059803: creating Jul 06 12:25:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fdc3d21d-a3a5-453a-815f-432d9e33459e tempest-GroupSnapshotsTest-352563802 None] Group tempest-GroupSnapshotsTest-Group-738059803: created successfully Jul 06 12:25:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fdc3d21d-a3a5-453a-815f-432d9e33459e tempest-GroupSnapshotsTest-352563802 None] Create group completed successfully. Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=83,cinder:INSERT=14,cinder:UPDATE=77,cinder:DELETE=4 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=90,cinder:SELECT=67,cinder:INSERT=24,cinder:DELETE=4 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Flow 'volume_create_manager' (1c26aeea-8859-4e55-bc1b-97e373a4d8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd594ce-eadb-4f59-84ed-43614eb8dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd594ce-eadb-4f59-84ed-43614eb8dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1463313291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f71280e-c792-4472-abe6-55fb899bd9e9,host='devstack@QuobyteHD#QuobyteHD',id=1087df3d-aac9-42ef-970f-8041645c252f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c9e518665b404f8ea2af14d979e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:28Z,use_quota=True,user_id='ca0ebc5358ff46ed8283940bff21420a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e6bc85-4cbd-4f35-b4b3-d5112f71d428),volume_type_id=02e6bc85-4cbd-4f35-b4b3-d5112f71d428)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d14297-c701-4c93-bc48-942377d7dbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d14297-c701-4c93-bc48-942377d7dbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3694fc4-aa1e-49d9-aafc-caa207d45646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3694fc4-aa1e-49d9-aafc-caa207d45646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1087df3d-aac9-42ef-970f-8041645c252f', 'volume_name': 'volume-1087df3d-aac9-42ef-970f-8041645c252f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737be711-1314-4399-a434-13c640d24b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737be711-1314-4399-a434-13c640d24b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b324691-3191-4054-a7c0-59e9ca434835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:28 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Volume 1087df3d-aac9-42ef-970f-8041645c252f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1087df3d-aac9-42ef-970f-8041645c252f', 'volume_size': 1} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f71280e-c792-4472-abe6-55fb899bd9e9,created_at=2026-07-06T10:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1463313291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f71280e-c792-4472-abe6-55fb899bd9e9,host='devstack@QuobyteHD#QuobyteHD',id=1087df3d-aac9-42ef-970f-8041645c252f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c9e518665b404f8ea2af14d979e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:28Z,use_quota=True,user_id='ca0ebc5358ff46ed8283940bff21420a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e6bc85-4cbd-4f35-b4b3-d5112f71d428),volume_type_id=02e6bc85-4cbd-4f35-b4b3-d5112f71d428)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Creating volume 1087df3d-aac9-42ef-970f-8041645c252f {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:25:28 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:25:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:28 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f 1073741824 Jul 06 12:25:28 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:29 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f 1073741824" returned: 0 in 1.003s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:29 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f Jul 06 12:25:29 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:30 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f" returned: 0 in 0.829s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:25:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b324691-3191-4054-a7c0-59e9ca434835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1087df3d-aac9-42ef-970f-8041645c252f', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4932c41-1aa9-4bae-94a0-49a956ab133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:30 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Volume volume-1087df3d-aac9-42ef-970f-8041645c252f (1087df3d-aac9-42ef-970f-8041645c252f): created successfully Jul 06 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4932c41-1aa9-4bae-94a0-49a956ab133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Flow 'volume_create_manager' (1c26aeea-8859-4e55-bc1b-97e373a4d8f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-79101bdb-fa68-47ad-942d-35990e097a9a tempest-GroupSnapshotsTest-352563802 None] Created volume successfully. Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Flow 'volume_create_manager' (238ccc08-c0dd-46bd-9dbc-03fd7c40934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0593ebd4-1121-468a-9b81-2330f321665a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0593ebd4-1121-468a-9b81-2330f321665a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2069448862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f71280e-c792-4472-abe6-55fb899bd9e9,host='devstack@QuobyteHD#QuobyteHD',id=d717016c-0ba6-4aed-a72c-a1f7c54fa0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c9e518665b404f8ea2af14d979e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:32Z,use_quota=True,user_id='ca0ebc5358ff46ed8283940bff21420a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e6bc85-4cbd-4f35-b4b3-d5112f71d428),volume_type_id=02e6bc85-4cbd-4f35-b4b3-d5112f71d428)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62eadf16-9e80-4d09-a75b-6a671f4d4a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62eadf16-9e80-4d09-a75b-6a671f4d4a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8db23d4-ea88-48b1-8e80-0283d7c39e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8db23d4-ea88-48b1-8e80-0283d7c39e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd717016c-0ba6-4aed-a72c-a1f7c54fa0f4', 'volume_name': 'volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91ff048-d58a-4358-b680-6076ff95c6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91ff048-d58a-4358-b680-6076ff95c6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f4425f-c538-4c79-9dd0-23d8ecbbf938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Volume d717016c-0ba6-4aed-a72c-a1f7c54fa0f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4', 'volume_size': 1} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f71280e-c792-4472-abe6-55fb899bd9e9,created_at=2026-07-06T10:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2069448862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f71280e-c792-4472-abe6-55fb899bd9e9,host='devstack@QuobyteHD#QuobyteHD',id=d717016c-0ba6-4aed-a72c-a1f7c54fa0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c9e518665b404f8ea2af14d979e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:25:32Z,use_quota=True,user_id='ca0ebc5358ff46ed8283940bff21420a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e6bc85-4cbd-4f35-b4b3-d5112f71d428),volume_type_id=02e6bc85-4cbd-4f35-b4b3-d5112f71d428)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Creating volume d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:25:31 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:25:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:31 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 1073741824 Jul 06 12:25:31 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:32 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 1073741824" returned: 0 in 0.884s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:32 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 Jul 06 12:25:32 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:25:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:32 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:25:32 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:33 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4" returned: 0 in 0.912s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f4425f-c538-4c79-9dd0-23d8ecbbf938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47dcd6e7-9c3d-4018-ac53-68fdec8ff2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:25:33 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Volume volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 (d717016c-0ba6-4aed-a72c-a1f7c54fa0f4): created successfully Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47dcd6e7-9c3d-4018-ac53-68fdec8ff2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Flow 'volume_create_manager' (238ccc08-c0dd-46bd-9dbc-03fd7c40934b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:25:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e6341ba7-5e60-48cc-b59f-76185aad44fd tempest-GroupSnapshotsTest-352563802 None] Created volume successfully. Jul 06 12:25:33 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.841s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:25:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:25:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-583e1e6f-da2e-4a1f-8b67-a0eb4ac108bb tempest-GroupSnapshotsTest-352563802 None] Update group completed successfully. Jul 06 12:25:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4202881d-950c-495b-b170-8e481f126599 tempest-GroupSnapshotsTest-352563802 None] Update group completed successfully. Jul 06 12:25:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-13f7bcaf-9c88-4139-b65f-f34ac6d1052c tempest-GroupSnapshotsTest-352563802 None] Update group completed successfully. Jul 06 12:25:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-be96d7e5-3dc7-42b7-91d3-f3351ca6f33b tempest-GroupSnapshotsTest-352563802 None] Update group completed successfully. Jul 06 12:25:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] GroupSnapshot 166bf874-4e4a-4ea4-adff-88216a36b0fa: creating. Jul 06 12:25:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Group snapshot 166bf874-4e4a-4ea4-adff-88216a36b0fa: creating. {{(pid=86561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:25:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Creating offline snapshot 367581ea-31ba-44c8-846c-735b1afb1b6f of volume 1087df3d-aac9-42ef-970f-8041645c252f {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:25:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[95efdf10-69b7-40b9-9957-d3e7caf13992]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:39 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f Jul 06 12:25:39 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:40 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f" returned: 0 in 0.900s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:40 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f 1G Jul 06 12:25:40 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:41 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f 1G" returned: 0 in 0.926s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1087df3d-aac9-42ef-970f-8041645c252f -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:41 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1087df3d-aac9-42ef-970f-8041645c252f -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f Jul 06 12:25:41 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:42 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1087df3d-aac9-42ef-970f-8041645c252f -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f" returned: 0 in 0.796s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:42 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:42 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f Jul 06 12:25:42 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:42 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f" returned: 0 in 0.719s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:43 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.info Jul 06 12:25:43 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:43 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.info" returned: 0 in 0.691s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:43 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:43 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.info Jul 06 12:25:43 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:44 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.info" returned: 0 in 0.902s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.030s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:25:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:25:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Creating offline snapshot b8ae4bff-c51a-4225-a802-279fb7851281 of volume d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:25:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb59308c-e387-4ba3-8c9f-a2ed76a6eb71]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:44 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 Jul 06 12:25:44 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:45 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4" returned: 0 in 0.878s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:45 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 1G Jul 06 12:25:45 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:46 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 1G" returned: 0 in 0.891s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:46 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 Jul 06 12:25:46 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:47 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281" returned: 0 in 0.805s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:47 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:47 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 Jul 06 12:25:47 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:47 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281" returned: 0 in 0.705s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:48 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.info Jul 06 12:25:48 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:48 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.info" returned: 0 in 0.838s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:48 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:25:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:48 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.info Jul 06 12:25:48 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:49 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.info" returned: 0 in 1.020s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.248s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:25:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f30d14f3-f72d-481a-8034-1fd5dffa869c tempest-GroupSnapshotsTest-352563802 None] group_snapshot 166bf874-4e4a-4ea4-adff-88216a36b0fa: created successfully Jul 06 12:25:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] group_snapshot 166bf874-4e4a-4ea4-adff-88216a36b0fa: deleting Jul 06 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] group_snapshot 166bf874-4e4a-4ea4-adff-88216a36b0fa: deleting {{(pid=86561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-1087df3d-aac9-42ef-970f-8041645c252f" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-1087df3d-aac9-42ef-970f-8041645c252f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-367581ea-31ba-44c8-846c-735b1afb1b6f" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-367581ea-31ba-44c8-846c-735b1afb1b6f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Deleting offline snapshot 367581ea-31ba-44c8-846c-735b1afb1b6f of volume 1087df3d-aac9-42ef-970f-8041645c252f {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:25:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] snapshot_file for this snap is: volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:25:50 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7bce72-ba3c-40e3-9b48-5b777f446dbd]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:50 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f Jul 06 12:25:50 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:51 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f" returned: 0 in 0.963s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1087df3d-aac9-42ef-970f-8041645c252f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:25:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fe636b-4a03-42d9-81e2-a74b4e2abd2b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:51 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f Jul 06 12:25:51 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:52 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f" returned: 0 in 1.038s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:52 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f Jul 06 12:25:52 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:53 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f" returned: 0 in 0.876s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:53 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f Jul 06 12:25:53 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:54 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f.367581ea-31ba-44c8-846c-735b1afb1b6f" returned: 0 in 0.895s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-367581ea-31ba-44c8-846c-735b1afb1b6f" released by "_delete_snapshot" :: held 3.915s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-1087df3d-aac9-42ef-970f-8041645c252f" released by "delete_snapshot" :: held 3.942s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-b8ae4bff-c51a-4225-a802-279fb7851281" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-b8ae4bff-c51a-4225-a802-279fb7851281" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Deleting offline snapshot b8ae4bff-c51a-4225-a802-279fb7851281 of volume d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:25:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] snapshot_file for this snap is: volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:25:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59561fe-26b6-4288-962e-4a620efe8783]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:54 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 Jul 06 12:25:54 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:55 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281" returned: 0 in 0.932s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:25:55 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b55ad-5363-4c12-832c-ec928bd8c911]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:55 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 Jul 06 12:25:55 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:56 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4" returned: 0 in 0.933s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:56 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 Jul 06 12:25:56 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:57 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281" returned: 0 in 0.903s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:57 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281 Jul 06 12:25:57 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:25:58 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 06 12:25:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4.b8ae4bff-c51a-4225-a802-279fb7851281" returned: 0 in 0.831s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:25:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-b8ae4bff-c51a-4225-a802-279fb7851281" released by "_delete_snapshot" :: held 3.749s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4" released by "delete_snapshot" :: held 3.781s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:25:58 devstack cinder-volume[86561]: WARNING cinder.quota [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2112094898 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2112094898, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:58 devstack cinder-volume[86561]: WARNING cinder.quota [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2112094898 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2112094898, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:25:58 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Created reservations ['8b57fb8b-55c1-4a7c-9289-c93769bdc69d', 'b5265424-15d1-47ac-af95-ed13a354d6c1', '6fa0d0e7-2976-42a2-8fb4-1fc74e3528c8', '757b7d6a-ae3b-48d2-81fd-facd7ce84c7e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:58 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] Created reservations ['0b730ee1-da64-4d0b-8912-1699dec22709', '429bd837-5909-40c8-b0a2-55bec446146b', 'a458e902-bd56-48e3-b5b5-c062e259c867', '39ff412a-857d-407b-bd39-0e081d98d911'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:25:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7f75af4f-1582-46c3-a687-923c81d56716 tempest-GroupSnapshotsTest-352563802 None] group_snapshot 166bf874-4e4a-4ea4-adff-88216a36b0fa: deleted successfully Jul 06 12:25:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-1087df3d-aac9-42ef-970f-8041645c252f" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:25:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-1087df3d-aac9-42ef-970f-8041645c252f" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:25:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c746e954-efb1-4051-86d0-d55c42f25899]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:25:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:25:59 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f Jul 06 12:25:59 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:00 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f" returned: 0 in 0.896s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:00 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f Jul 06 12:26:00 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:01 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1087df3d-aac9-42ef-970f-8041645c252f" returned: 0 in 0.725s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-1087df3d-aac9-42ef-970f-8041645c252f" released by "delete_volume" :: held 1.724s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b70fc4c-5744-4369-8076-0d08cceaa9ae]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:01 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 Jul 06 12:26:01 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:02 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4" returned: 0 in 0.965s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:02 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4 Jul 06 12:26:02 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:03 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4" returned: 0 in 0.724s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-d717016c-0ba6-4aed-a72c-a1f7c54fa0f4" released by "delete_volume" :: held 1.775s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:03 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Created reservations ['2055fc3a-17ed-4a64-896d-028ee9e6b897'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:03 devstack cinder-volume[86561]: WARNING cinder.quota [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2112094898 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2112094898, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:26:03 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Created reservations ['0e127b38-7876-4650-973c-b85c01e64214', 'e21ffc2f-dc6f-432a-bc30-82dacfba4147', '2ddc4095-cf64-4f63-acd4-07351012d021', '37b586f2-08c5-4be7-8e1e-a6d5cabc493b'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:03 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Created reservations ['ca891e9e-78f1-4292-8104-ac0ca8d238f3', 'e3edd444-bede-4356-8efd-562f93ee5a34', 'b1dd2140-f9a8-45a7-9ef2-7933c418c5bb', '063e0f5e-52a6-4d83-90f8-a0ea33c09271'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:03 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:26:03 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:04 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.874s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:04 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:26:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-aedc4ace-307b-46d2-b4d3-8d72add702fb tempest-GroupSnapshotsTest-352563802 None] Delete group completed successfully. Jul 06 12:26:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-82b4cb42-6db2-4a1c-b984-e84b080af8c2 tempest-GroupSnapshotsTest-352563802 None] Group tempest-GroupSnapshotsTest-Group-557031065: creating Jul 06 12:26:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-82b4cb42-6db2-4a1c-b984-e84b080af8c2 tempest-GroupSnapshotsTest-352563802 None] Group tempest-GroupSnapshotsTest-Group-557031065: created successfully Jul 06 12:26:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-82b4cb42-6db2-4a1c-b984-e84b080af8c2 tempest-GroupSnapshotsTest-352563802 None] Create group completed successfully. Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Flow 'volume_create_manager' (361bc7d3-9dc6-472b-abfb-7ba9c07bec26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697c6c3b-f676-406f-9a82-a3198be79fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697c6c3b-f676-406f-9a82-a3198be79fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-40810576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b168c91b22af484cb5a96ae3427c729c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:06Z,use_quota=True,user_id='f540e733fa3f48e29b275dc12879bc7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e4a90a-2f5a-458e-aa97-6471d9f083b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e4a90a-2f5a-458e-aa97-6471d9f083b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1245c79-fc4e-4db3-bccf-31d521f3dec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1245c79-fc4e-4db3-bccf-31d521f3dec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8', 'volume_name': 'volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9575c11-7921-434b-98e0-96b00177a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9575c11-7921-434b-98e0-96b00177a44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c272679-2a37-4d0e-81a2-20636449eeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Volume 24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8', 'volume_size': 1} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-40810576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b168c91b22af484cb5a96ae3427c729c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:06Z,use_quota=True,user_id='f540e733fa3f48e29b275dc12879bc7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Creating volume 24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:26:05 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:26:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:05 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 1073741824 Jul 06 12:26:05 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Flow 'volume_create_manager' (21a82ece-e5a6-424d-83f0-586857b89e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ed7443-c715-48dc-93af-49701753765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ed7443-c715-48dc-93af-49701753765b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300632213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4d02816d-7616-4fd8-8425-95034fe6bb56,host='devstack@QuobyteHD#QuobyteHD',id=6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c9e518665b404f8ea2af14d979e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:07Z,use_quota=True,user_id='ca0ebc5358ff46ed8283940bff21420a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d11ae0f5-db9b-4b08-8b4e-c83e115716b4),volume_type_id=d11ae0f5-db9b-4b08-8b4e-c83e115716b4)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f1b01f-9c7f-47ed-9ade-92d487a9b1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f1b01f-9c7f-47ed-9ade-92d487a9b1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9280501c-fd4e-4944-b41e-838571f8b4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9280501c-fd4e-4944-b41e-838571f8b4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a', 'volume_name': 'volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f623599-39ee-4d54-879f-4400002e4009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f623599-39ee-4d54-879f-4400002e4009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2adb99-371c-4e6c-83c8-21f37360aca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Volume 6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a', 'volume_size': 1} Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:06 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 1073741824" returned: 0 in 1.123s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:07 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 Jul 06 12:26:07 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:07 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" returned: 0 in 0.773s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.890s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4d02816d-7616-4fd8-8425-95034fe6bb56,created_at=2026-07-06T10:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1300632213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4d02816d-7616-4fd8-8425-95034fe6bb56,host='devstack@QuobyteHD#QuobyteHD',id=6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c9e518665b404f8ea2af14d979e0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:07Z,use_quota=True,user_id='ca0ebc5358ff46ed8283940bff21420a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d11ae0f5-db9b-4b08-8b4e-c83e115716b4),volume_type_id=d11ae0f5-db9b-4b08-8b4e-c83e115716b4)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Creating volume 6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:26:07 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:07 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a 1073741824 Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c272679-2a37-4d0e-81a2-20636449eeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:07 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a168018a-a3df-4af1-87aa-fdff953f38b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Volume volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 (24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8): created successfully Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a168018a-a3df-4af1-87aa-fdff953f38b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Flow 'volume_create_manager' (361bc7d3-9dc6-472b-abfb-7ba9c07bec26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-40a06e40-e086-4f78-a664-013ea6cca260 tempest-TestStampPattern-1605817143 None] Created volume successfully. Jul 06 12:26:08 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a 1073741824" returned: 0 in 0.933s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:08 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a Jul 06 12:26:08 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:09 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a" returned: 0 in 0.692s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:26:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2adb99-371c-4e6c-83c8-21f37360aca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513f2df0-d266-4649-91f5-11ab077d37cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Volume volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a (6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a): created successfully Jul 06 12:26:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513f2df0-d266-4649-91f5-11ab077d37cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Flow 'volume_create_manager' (21a82ece-e5a6-424d-83f0-586857b89e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d0dc3b07-f369-412c-b13f-e138dd207366 tempest-GroupSnapshotsTest-352563802 None] Created volume successfully. Jul 06 12:26:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] GroupSnapshot d097cf14-ca7e-4f48-bcaf-71999db08167: creating. Jul 06 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] Group snapshot d097cf14-ca7e-4f48-bcaf-71999db08167: creating. {{(pid=86561) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 12:26:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] Creating offline snapshot fd7a1b59-7007-44b8-944c-24c42378fe63 of volume 6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:26:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffee3dd-193c-4933-b6c5-89cb379e9414]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:10 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a Jul 06 12:26:10 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:11 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a" returned: 0 in 0.906s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:11 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 1G Jul 06 12:26:11 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:12 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 1G" returned: 0 in 1.187s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:12 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 Jul 06 12:26:12 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:13 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63" returned: 0 in 0.856s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:13 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:26:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:13 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 Jul 06 12:26:13 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:14 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63" returned: 0 in 0.815s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:14 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.info Jul 06 12:26:14 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:15 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.info" returned: 0 in 0.712s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:15 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 12:26:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:15 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.info Jul 06 12:26:15 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:15 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.info" returned: 0 in 0.728s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.299s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6c033391-fa9c-44a1-83db-96421d5c6a70 tempest-GroupSnapshotsTest-352563802 None] group_snapshot d097cf14-ca7e-4f48-bcaf-71999db08167: created successfully Jul 06 12:26:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] group_snapshot d097cf14-ca7e-4f48-bcaf-71999db08167: deleting Jul 06 12:26:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] group_snapshot d097cf14-ca7e-4f48-bcaf-71999db08167: deleting {{(pid=86561) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 12:26:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-fd7a1b59-7007-44b8-944c-24c42378fe63" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-fd7a1b59-7007-44b8-944c-24c42378fe63" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Deleting offline snapshot fd7a1b59-7007-44b8-944c-24c42378fe63 of volume 6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:26:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] snapshot_file for this snap is: volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:26:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[840dbb1a-94b3-4665-8242-99b9694ae52a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:17 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 Jul 06 12:26:17 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:18 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63" returned: 0 in 1.165s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:26:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed244b06-f6f0-47ec-b13c-86f5d7faf216]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:18 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a Jul 06 12:26:18 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:19 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a" returned: 0 in 0.843s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:19 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 Jul 06 12:26:19 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:20 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63" returned: 0 in 0.800s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:20 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63 Jul 06 12:26:20 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:20 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a.fd7a1b59-7007-44b8-944c-24c42378fe63" returned: 0 in 0.713s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-fd7a1b59-7007-44b8-944c-24c42378fe63" released by "_delete_snapshot" :: held 3.644s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a" released by "delete_snapshot" :: held 3.676s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:21 devstack cinder-volume[86561]: WARNING cinder.quota [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-748026019 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-748026019, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:26:21 devstack cinder-volume[86561]: WARNING cinder.quota [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-748026019 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-748026019, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:26:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] Created reservations ['05285e35-43be-4d1b-a75d-a486ed90ac42', '529e4bb0-77e3-4c16-8860-7d604a2ef2b4', 'f72f6356-70e9-42ba-891f-767348dabf0b', 'b0ccdead-16b1-4262-a30b-1a3a4f713969'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b0e395b3-797f-4312-bad7-6fdf9324156f tempest-GroupSnapshotsTest-352563802 None] group_snapshot d097cf14-ca7e-4f48-bcaf-71999db08167: deleted successfully Jul 06 12:26:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "cinder-quobyte-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c31de2-8512-45dc-9b20-355a3b492cf8]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:22 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a Jul 06 12:26:22 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:23 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a" returned: 0 in 1.022s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:23 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a Jul 06 12:26:23 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:23 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a" returned: 0 in 0.795s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Lock "cinder-quobyte-6b2f08bd-18e0-4b2f-b448-6cc3e83a5b0a" released by "delete_volume" :: held 1.909s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:23 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Created reservations ['2fc7ea6f-2859-4c45-a496-858e60074df8'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:24 devstack cinder-volume[86561]: WARNING cinder.quota [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-748026019 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-748026019, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:26:24 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Created reservations ['9031e5b2-c13c-449d-bbf3-bc1aa13fb835', '3bf3060e-ae1e-4005-8976-26c11a50a3ad', 'd82dde44-433f-48eb-aec5-62f46bfe5077', 'd368c3ff-b819-4535-a600-f6b1732ef182'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:24 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:26:24 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:25 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.929s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:26:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e08f19f1-a9dd-40fe-a11e-3478e3deb935 tempest-GroupSnapshotsTest-352563802 None] Delete group completed successfully. Jul 06 12:26:30 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=68,cinder:SELECT=72,cinder:DELETE=2,cinder:INSERT=14 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:26:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-80e8dae9-8bd3-4126-9b3a-085e547da567 tempest-GroupsTest-1362685504 None] Group tempest-Group1-215315212: creating Jul 06 12:26:30 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=73,cinder:INSERT=19,cinder:UPDATE=73,cinder:DELETE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:26:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-80e8dae9-8bd3-4126-9b3a-085e547da567 tempest-GroupsTest-1362685504 None] Group tempest-Group1-215315212: created successfully Jul 06 12:26:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-80e8dae9-8bd3-4126-9b3a-085e547da567 tempest-GroupsTest-1362685504 None] Create group completed successfully. Jul 06 12:26:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9f8b4621-753f-4a93-b311-23421da79bf7 tempest-GroupsTest-1362685504 None] Group tempest-Group2-394541210: creating Jul 06 12:26:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9f8b4621-753f-4a93-b311-23421da79bf7 tempest-GroupsTest-1362685504 None] Group tempest-Group2-394541210: created successfully Jul 06 12:26:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9f8b4621-753f-4a93-b311-23421da79bf7 tempest-GroupsTest-1362685504 None] Create group completed successfully. Jul 06 12:26:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:26:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:32 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:26:32 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Flow 'volume_create_manager' (0b4da09c-3fa6-425c-93da-bd7214525667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720aec4f-1f13-4b7f-a3c8-3000ae54f355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720aec4f-1f13-4b7f-a3c8-3000ae54f355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1584326575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e864444c-89e2-421d-b99d-87d58784f251,host='devstack@QuobyteHD#QuobyteHD',id=b87afd8b-a68b-4716-a8d2-8145155b4c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46590073cc6445d6bd4a3c976b91d871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:34Z,use_quota=True,user_id='a6862e3cff9e426fa75f33df60f67302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370b2acc-9cfd-4a35-b2cf-a15cdcc8873f),volume_type_id=370b2acc-9cfd-4a35-b2cf-a15cdcc8873f)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acf9fa0-6b34-45be-b20a-3634b26c5a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acf9fa0-6b34-45be-b20a-3634b26c5a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493bf96e-1312-4ec4-badf-6113d0921527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493bf96e-1312-4ec4-badf-6113d0921527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b87afd8b-a68b-4716-a8d2-8145155b4c09', 'volume_name': 'volume-b87afd8b-a68b-4716-a8d2-8145155b4c09', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ce0b47-0490-4ea9-8b20-8aa1f2e84e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ce0b47-0490-4ea9-8b20-8aa1f2e84e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcfa263-4ebe-43ab-b7b8-6b3ca1865726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:33 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Volume b87afd8b-a68b-4716-a8d2-8145155b4c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b87afd8b-a68b-4716-a8d2-8145155b4c09', 'volume_size': 1} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e864444c-89e2-421d-b99d-87d58784f251,created_at=2026-07-06T10:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1584326575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e864444c-89e2-421d-b99d-87d58784f251,host='devstack@QuobyteHD#QuobyteHD',id=b87afd8b-a68b-4716-a8d2-8145155b4c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46590073cc6445d6bd4a3c976b91d871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:34Z,use_quota=True,user_id='a6862e3cff9e426fa75f33df60f67302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370b2acc-9cfd-4a35-b2cf-a15cdcc8873f),volume_type_id=370b2acc-9cfd-4a35-b2cf-a15cdcc8873f)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Creating volume b87afd8b-a68b-4716-a8d2-8145155b4c09 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:26:33 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:33 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09 1073741824 Jul 06 12:26:33 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:33 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.047s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:26:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:26:34 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09 1073741824" returned: 0 in 0.980s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:34 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09 Jul 06 12:26:34 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:35 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09" returned: 0 in 0.828s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:26:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcfa263-4ebe-43ab-b7b8-6b3ca1865726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b87afd8b-a68b-4716-a8d2-8145155b4c09', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677cb0b9-764f-4c80-88dd-52892ce58c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Volume volume-b87afd8b-a68b-4716-a8d2-8145155b4c09 (b87afd8b-a68b-4716-a8d2-8145155b4c09): created successfully Jul 06 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677cb0b9-764f-4c80-88dd-52892ce58c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Flow 'volume_create_manager' (0b4da09c-3fa6-425c-93da-bd7214525667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d7d7561b-f0bc-4db4-8a94-732c4d9373d7 tempest-GroupsTest-1362685504 None] Created volume successfully. Jul 06 12:26:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Acquiring lock "cinder-quobyte-b87afd8b-a68b-4716-a8d2-8145155b4c09" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Lock "cinder-quobyte-b87afd8b-a68b-4716-a8d2-8145155b4c09" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[84da7e47-5858-40d4-97bb-99364a5cbe61]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:37 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09 Jul 06 12:26:37 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:37 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09" returned: 0 in 0.919s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:37 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09 Jul 06 12:26:37 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:38 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b87afd8b-a68b-4716-a8d2-8145155b4c09" returned: 0 in 0.654s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Lock "cinder-quobyte-b87afd8b-a68b-4716-a8d2-8145155b4c09" released by "delete_volume" :: held 1.615s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Created reservations ['c6555aa3-2fd3-4e1b-bf47-e70f741bd88f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:38 devstack cinder-volume[86561]: WARNING cinder.quota [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-669386745 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-669386745, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:26:38 devstack cinder-volume[86561]: WARNING cinder.quota [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-669386745 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-669386745, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:26:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Created reservations ['75a3cca7-b7f2-4666-845a-59ff0928876f', '3340c681-af0f-46e4-b094-bf4c5512e017', 'd3d340d5-b8a8-48e3-a962-16b03003aa71', '0ecab1f0-7aaa-4ff3-ace3-96cd964dd949'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:38 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:26:38 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:39 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a70a515c-823b-4400-a9d5-1ff4dde28a1b tempest-GroupsTest-1362685504 None] Created reservations ['b17ec6e9-76e5-4fb1-9929-5e27e727fd16'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:39 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.733s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:39 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:26:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-27730c23-db20-4c9e-8e84-df5a0ea33360 tempest-GroupsTest-1362685504 None] Delete group completed successfully. Jul 06 12:26:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a70a515c-823b-4400-a9d5-1ff4dde28a1b tempest-GroupsTest-1362685504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a70a515c-823b-4400-a9d5-1ff4dde28a1b tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a70a515c-823b-4400-a9d5-1ff4dde28a1b tempest-GroupsTest-1362685504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a70a515c-823b-4400-a9d5-1ff4dde28a1b tempest-GroupsTest-1362685504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a70a515c-823b-4400-a9d5-1ff4dde28a1b tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a70a515c-823b-4400-a9d5-1ff4dde28a1b tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:39 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:26:39 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:40 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a70a515c-823b-4400-a9d5-1ff4dde28a1b tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.723s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:40 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a70a515c-823b-4400-a9d5-1ff4dde28a1b tempest-GroupsTest-1362685504 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:26:40 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a70a515c-823b-4400-a9d5-1ff4dde28a1b tempest-GroupsTest-1362685504 None] Delete group completed successfully. Jul 06 12:26:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c6de6fbc-041c-4eb4-b70f-5f750da7d64c tempest-GroupsTest-1362685504 None] Group tempest-GroupsTest-Group-2017227218: creating Jul 06 12:26:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c6de6fbc-041c-4eb4-b70f-5f750da7d64c tempest-GroupsTest-1362685504 None] Group tempest-GroupsTest-Group-2017227218: created successfully Jul 06 12:26:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c6de6fbc-041c-4eb4-b70f-5f750da7d64c tempest-GroupsTest-1362685504 None] Create group completed successfully. Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Flow 'volume_create_manager' (4727f9ef-e01f-4fa3-bb05-df0819e88c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3365cc-efd9-4412-86da-d97c82966198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3365cc-efd9-4412-86da-d97c82966198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1447349293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83efd701-297f-4c83-ac2c-78983cf17035,host='devstack@QuobyteHD#QuobyteHD',id=b332f143-8035-48df-8efa-627f6f9cfaa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46590073cc6445d6bd4a3c976b91d871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:43Z,use_quota=True,user_id='a6862e3cff9e426fa75f33df60f67302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95680337-7d91-40ab-98ce-b44f874fc570),volume_type_id=95680337-7d91-40ab-98ce-b44f874fc570)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde8fd35-13cb-4ee0-b7fd-1abb3b32c18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde8fd35-13cb-4ee0-b7fd-1abb3b32c18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2983f6a0-34cb-4c4a-a82a-2d38086b5ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2983f6a0-34cb-4c4a-a82a-2d38086b5ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b332f143-8035-48df-8efa-627f6f9cfaa4', 'volume_name': 'volume-b332f143-8035-48df-8efa-627f6f9cfaa4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac51956c-9335-4acf-9b5a-0bc0d3eab881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac51956c-9335-4acf-9b5a-0bc0d3eab881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180493bd-30cb-4644-9485-1aeaa34ced6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:42 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Volume b332f143-8035-48df-8efa-627f6f9cfaa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b332f143-8035-48df-8efa-627f6f9cfaa4', 'volume_size': 1} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83efd701-297f-4c83-ac2c-78983cf17035,created_at=2026-07-06T10:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1447349293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83efd701-297f-4c83-ac2c-78983cf17035,host='devstack@QuobyteHD#QuobyteHD',id=b332f143-8035-48df-8efa-627f6f9cfaa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46590073cc6445d6bd4a3c976b91d871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:43Z,use_quota=True,user_id='a6862e3cff9e426fa75f33df60f67302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95680337-7d91-40ab-98ce-b44f874fc570),volume_type_id=95680337-7d91-40ab-98ce-b44f874fc570)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Creating volume b332f143-8035-48df-8efa-627f6f9cfaa4 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:26:42 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:26:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:42 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4 1073741824 Jul 06 12:26:42 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:43 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4 1073741824" returned: 0 in 0.832s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:43 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4 Jul 06 12:26:43 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:44 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4" returned: 0 in 0.685s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:26:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180493bd-30cb-4644-9485-1aeaa34ced6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b332f143-8035-48df-8efa-627f6f9cfaa4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2650a6d0-fdd9-462a-9865-832f28834077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:44 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Volume volume-b332f143-8035-48df-8efa-627f6f9cfaa4 (b332f143-8035-48df-8efa-627f6f9cfaa4): created successfully Jul 06 12:26:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2650a6d0-fdd9-462a-9865-832f28834077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Flow 'volume_create_manager' (4727f9ef-e01f-4fa3-bb05-df0819e88c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f7d95cc6-243d-4702-b9c6-49ff5817ec8b tempest-GroupsTest-1362685504 None] Created volume successfully. Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Flow 'volume_create_manager' (14dfab8c-9cb4-49e4-a1f4-7a4bc912e3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d72628-8ffb-44f9-904d-f6b64a52f41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d72628-8ffb-44f9-904d-f6b64a52f41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-496227025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83efd701-297f-4c83-ac2c-78983cf17035,host='devstack@QuobyteHD#QuobyteHD',id=95dd15f2-5a5d-4967-a9a4-e0ef6216a598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46590073cc6445d6bd4a3c976b91d871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:46Z,use_quota=True,user_id='a6862e3cff9e426fa75f33df60f67302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95680337-7d91-40ab-98ce-b44f874fc570),volume_type_id=95680337-7d91-40ab-98ce-b44f874fc570)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68d36a2-93b8-41b3-b02c-55314d521ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68d36a2-93b8-41b3-b02c-55314d521ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f591f4d-8ca7-493d-8ec1-2f74da4e3606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f591f4d-8ca7-493d-8ec1-2f74da4e3606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95dd15f2-5a5d-4967-a9a4-e0ef6216a598', 'volume_name': 'volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0913596c-2558-4443-bc32-2e8746db910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0913596c-2558-4443-bc32-2e8746db910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc041c3e-541a-49c7-b1c6-3e0f2ccd176b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:45 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Volume 95dd15f2-5a5d-4967-a9a4-e0ef6216a598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598', 'volume_size': 1} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83efd701-297f-4c83-ac2c-78983cf17035,created_at=2026-07-06T10:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-496227025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83efd701-297f-4c83-ac2c-78983cf17035,host='devstack@QuobyteHD#QuobyteHD',id=95dd15f2-5a5d-4967-a9a4-e0ef6216a598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46590073cc6445d6bd4a3c976b91d871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:26:46Z,use_quota=True,user_id='a6862e3cff9e426fa75f33df60f67302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95680337-7d91-40ab-98ce-b44f874fc570),volume_type_id=95680337-7d91-40ab-98ce-b44f874fc570)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Creating volume 95dd15f2-5a5d-4967-a9a4-e0ef6216a598 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:26:45 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:26:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:45 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598 1073741824 Jul 06 12:26:45 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:46 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598 1073741824" returned: 0 in 0.895s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:46 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598 Jul 06 12:26:46 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:47 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598" returned: 0 in 0.692s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:26:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc041c3e-541a-49c7-b1c6-3e0f2ccd176b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7832c2ee-7cf8-4d7f-a54f-d00d96ad270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:26:47 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Volume volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598 (95dd15f2-5a5d-4967-a9a4-e0ef6216a598): created successfully Jul 06 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7832c2ee-7cf8-4d7f-a54f-d00d96ad270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:26:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Flow 'volume_create_manager' (14dfab8c-9cb4-49e4-a1f4-7a4bc912e3c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:26:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b99b9ce2-7d00-413f-b7fa-2f818e6345e1 tempest-GroupsTest-1362685504 None] Created volume successfully. Jul 06 12:26:48 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-007ed672-5618-4834-89d8-3daea632dc44 tempest-GroupsTest-1362685504 None] Update group completed successfully. Jul 06 12:26:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-ae5a2fe9-139d-4499-b391-c48bd74cd1f2 req-370206a9-bad0-4abd-b4b9-d8bed5d9e2d1 tempest-TestStampPattern-1605817143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-ae5a2fe9-139d-4499-b391-c48bd74cd1f2 req-370206a9-bad0-4abd-b4b9-d8bed5d9e2d1 tempest-TestStampPattern-1605817143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:48 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f04dfcb-b323-40b3-82a6-4f1e4a4a33e4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-ae5a2fe9-139d-4499-b391-c48bd74cd1f2 req-370206a9-bad0-4abd-b4b9-d8bed5d9e2d1 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:48 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 Jul 06 12:26:48 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:49 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-ae5a2fe9-139d-4499-b391-c48bd74cd1f2 req-370206a9-bad0-4abd-b4b9-d8bed5d9e2d1 tempest-TestStampPattern-1605817143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" returned: 0 in 0.784s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-ae5a2fe9-139d-4499-b391-c48bd74cd1f2 req-370206a9-bad0-4abd-b4b9-d8bed5d9e2d1 tempest-TestStampPattern-1605817143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.801s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-ae5a2fe9-139d-4499-b391-c48bd74cd1f2 req-370206a9-bad0-4abd-b4b9-d8bed5d9e2d1 tempest-TestStampPattern-1605817143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '476efb70-6a62-4e57-b1bf-ccbf1c2262c5', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:26:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-ae5a2fe9-139d-4499-b391-c48bd74cd1f2 req-370206a9-bad0-4abd-b4b9-d8bed5d9e2d1 tempest-TestStampPattern-1605817143 None] attachment_update completed successfully. Jul 06 12:26:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b7698b02-1be6-41f7-9646-67a764c05513 tempest-GroupsTest-1362685504 None] Update group completed successfully. Jul 06 12:26:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Acquiring lock "cinder-quobyte-95dd15f2-5a5d-4967-a9a4-e0ef6216a598" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Lock "cinder-quobyte-95dd15f2-5a5d-4967-a9a4-e0ef6216a598" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[492da212-3599-4ee4-b0c3-6aca1201de90]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:51 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598 Jul 06 12:26:51 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:52 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598" returned: 0 in 0.781s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:52 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598 Jul 06 12:26:52 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:52 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-95dd15f2-5a5d-4967-a9a4-e0ef6216a598" returned: 0 in 0.771s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Lock "cinder-quobyte-95dd15f2-5a5d-4967-a9a4-e0ef6216a598" released by "delete_volume" :: held 1.600s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Acquiring lock "cinder-quobyte-b332f143-8035-48df-8efa-627f6f9cfaa4" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:26:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Lock "cinder-quobyte-b332f143-8035-48df-8efa-627f6f9cfaa4" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:26:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eaff1e-fed0-4a10-81f4-49b770e58ac8]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:26:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:53 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4 Jul 06 12:26:53 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:53 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4" returned: 0 in 0.966s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:54 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4 Jul 06 12:26:54 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:54 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b332f143-8035-48df-8efa-627f6f9cfaa4" returned: 0 in 0.821s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Lock "cinder-quobyte-b332f143-8035-48df-8efa-627f6f9cfaa4" released by "delete_volume" :: held 1.834s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:26:54 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Created reservations ['2adc0d0e-0cbc-4cc0-a86c-d79cc528d8e7'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:55 devstack cinder-volume[86561]: WARNING cinder.quota [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1098822746 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1098822746, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:26:55 devstack cinder-volume[86561]: WARNING cinder.quota [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1098822746 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1098822746, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:26:55 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Created reservations ['7f171448-4835-41e6-976b-fdb536b7253c', '27d62429-012f-4900-a838-eac6b8d3342c', '171b0bd2-90e9-4986-a019-716783a0f7f9', '58ede601-e8fe-4bd3-bf13-5f3d06240c20'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:55 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Created reservations ['9943a23a-9c51-43bf-a92f-d2ee13d19d08', '47d59519-3b5a-4f48-9c8e-95ff1fb5181f', '172da575-9e8e-4e94-adb3-26a4771db5ea', 'd369b7dd-e594-41d4-938e-1580a35fe501'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:26:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:26:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:26:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:26:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:26:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:26:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:26:55 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:26:55 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:26:56 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 06 12:26:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.780s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:26:56 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:26:56 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e0581407-f08c-4172-bfc0-edaad0438bd2 tempest-GroupsTest-1362685504 None] Delete group completed successfully. Jul 06 12:26:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-c5f469bf-e0a5-4b87-a938-d44f460ea6fa req-e90167b0-d24d-4834-a0b8-57501a26edb8 tempest-TestStampPattern-1605817143 None] Terminate volume connection completed successfully. Jul 06 12:26:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-c5f469bf-e0a5-4b87-a938-d44f460ea6fa req-e90167b0-d24d-4834-a0b8-57501a26edb8 tempest-TestStampPattern-1605817143 None] Deleting attachment 476efb70-6a62-4e57-b1bf-ccbf1c2262c5. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:27:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] Creating offline snapshot ac802933-2d59-4ff6-a556-85ad41832659 of volume 24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:27:00 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9103b64c-7a7a-47ed-a236-750cacef336a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:00 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 Jul 06 12:27:00 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:01 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" returned: 0 in 0.936s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:01 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 1G Jul 06 12:27:01 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Flow 'volume_create_manager' (c3103914-68a8-43a3-86c9-907051a9bb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ada3d8-47c0-4ecd-b352-9166f449e4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ada3d8-47c0-4ecd-b352-9166f449e4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1347037867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b85554-fe3d-4d7a-94a6-ef4cf189ac14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b449dbd0c474676be4580aac771fecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:02Z,use_quota=True,user_id='6feebe9af4ac4dffa10107eec2fd0b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a49276-644d-4f96-947d-87c335f08d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a49276-644d-4f96-947d-87c335f08d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a29790-3516-45a7-9adb-8c399f7d0d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a29790-3516-45a7-9adb-8c399f7d0d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b85554-fe3d-4d7a-94a6-ef4cf189ac14', 'volume_name': 'volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8d7f3d-bb7c-44e1-976f-99493c7fd858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8d7f3d-bb7c-44e1-976f-99493c7fd858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b0ffd5-82e3-4c0e-b45e-fb483d9bba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14', 'volume_size': 1} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:02 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 1G" returned: 0 in 0.998s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:02 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 Jul 06 12:27:02 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:03 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659" returned: 0 in 0.740s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:03 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 is being set with open permissions: ugo+rw Jul 06 12:27:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:03 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 Jul 06 12:27:03 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:04 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659" returned: 0 in 0.670s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:04 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.info Jul 06 12:27:04 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:04 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.info" returned: 0 in 0.687s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:04 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.info is being set with open permissions: ugo+rw Jul 06 12:27:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:04 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.info Jul 06 12:27:04 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:05 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.info" returned: 0 in 0.688s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.813s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.093s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1347037867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b85554-fe3d-4d7a-94a6-ef4cf189ac14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b449dbd0c474676be4580aac771fecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:02Z,use_quota=True,user_id='6feebe9af4ac4dffa10107eec2fd0b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Creating volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:27:05 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:27:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:05 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 1073741824 Jul 06 12:27:05 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-47e9e78f-685c-4d7d-af52-9dd07c782038 tempest-TestStampPattern-1605817143 None] Create snapshot completed successfully Jul 06 12:27:06 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 1073741824" returned: 0 in 0.899s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:06 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 Jul 06 12:27:06 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:07 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" returned: 0 in 0.778s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b0ffd5-82e3-4c0e-b45e-fb483d9bba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbe76c9-4ebc-4a29-895b-1057fa7db79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Volume volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 (f9b85554-fe3d-4d7a-94a6-ef4cf189ac14): created successfully Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbe76c9-4ebc-4a29-895b-1057fa7db79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Flow 'volume_create_manager' (c3103914-68a8-43a3-86c9-907051a9bb73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-40b9c6e6-3b4f-4a80-8ac4-8f6dab4cb909 tempest-SnapshotsActionsTest-1419269836 None] Created volume successfully. Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] Creating offline snapshot fb412597-d724-4531-9890-f04f8f3ca507 of volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49cb9ee-9b80-4b6b-b7f5-f77ed8a09f9b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:07 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 Jul 06 12:27:07 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:08 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" returned: 0 in 0.844s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:08 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 1G Jul 06 12:27:08 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:09 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 1G" returned: 0 in 0.890s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:09 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:09 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:10 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 0.781s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:10 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 is being set with open permissions: ugo+rw Jul 06 12:27:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:10 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:10 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:11 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 0.727s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:11 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.info Jul 06 12:27:11 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:11 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.info" returned: 0 in 0.734s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:11 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.info is being set with open permissions: ugo+rw Jul 06 12:27:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:11 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.info Jul 06 12:27:11 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:12 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.info" returned: 0 in 0.748s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.829s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2914d8a6-4109-47f1-afec-42f567e55e26 tempest-SnapshotsActionsTest-1419269836 None] Create snapshot completed successfully Jul 06 12:27:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] Creating offline snapshot 2bb8f9a5-237e-4fec-99ed-4342ee88aa3c of volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:27:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce3c70e-5c5e-4d06-b5ce-ed1076eef73c]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:13 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:13 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:14 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 0.963s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:14 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c 1G Jul 06 12:27:14 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:15 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c 1G" returned: 0 in 1.028s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:15 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c Jul 06 12:27:15 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Flow 'volume_create_manager' (8e8b9b83-8625-4ba8-860c-b92adfc48bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c221b02-d7c1-4bad-8cd2-e97e9d587255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c221b02-d7c1-4bad-8cd2-e97e9d587255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2126365315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76af29c-8360-4653-ab8b-664c6c28b65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b168c91b22af484cb5a96ae3427c729c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac802933-2d59-4ff6-a556-85ad41832659,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:27:16Z,use_quota=True,user_id='f540e733fa3f48e29b275dc12879bc7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac072e65-b50c-46e3-ae3b-629ba4f0789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac072e65-b50c-46e3-ae3b-629ba4f0789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8252bb2-30df-4511-9adb-08df5ee362e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8252bb2-30df-4511-9adb-08df5ee362e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a76af29c-8360-4653-ab8b-664c6c28b65c', 'volume_name': 'volume-a76af29c-8360-4653-ab8b-664c6c28b65c', 'volume_size': 1, 'snapshot_id': 'ac802933-2d59-4ff6-a556-85ad41832659'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba93318-3345-4be8-a59e-6080c2a454aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba93318-3345-4be8-a59e-6080c2a454aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb54d9b-748a-453a-83e1-6aa9a63732fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:16 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Volume a76af29c-8360-4653-ab8b-664c6c28b65c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a76af29c-8360-4653-ab8b-664c6c28b65c', 'volume_size': 1, 'snapshot_id': 'ac802933-2d59-4ff6-a556-85ad41832659'} Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:16 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c" returned: 0 in 0.887s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:16 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c is being set with open permissions: ugo+rw Jul 06 12:27:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:16 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c Jul 06 12:27:16 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:17 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c" returned: 0 in 0.723s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.726s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.942s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Acquiring lock "cinder-quobyte-ac802933-2d59-4ff6-a556-85ad41832659-a76af29c-8360-4653-ab8b-664c6c28b65c" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-ac802933-2d59-4ff6-a556-85ad41832659-a76af29c-8360-4653-ab8b-664c6c28b65c" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Creating volume a76af29c-8360-4653-ab8b-664c6c28b65c from snapshot ac802933-2d59-4ff6-a556-85ad41832659 {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Acquiring lock "cinder-quobyte-a76af29c-8360-4653-ab8b-664c6c28b65c" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-a76af29c-8360-4653-ab8b-664c6c28b65c" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] snapshot: ac802933-2d59-4ff6-a556-85ad41832659, volume: a76af29c-8360-4653-ab8b-664c6c28b65c, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:27:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-61774913-e445-4c18-a83f-88ce4c1dc2cb tempest-SnapshotsActionsTest-1419269836 None] Create snapshot completed successfully Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9450e6b-2dce-43d7-96fb-b65d91ddcc10]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:17 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 Jul 06 12:27:17 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-2bb8f9a5-237e-4fec-99ed-4342ee88aa3c-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-2bb8f9a5-237e-4fec-99ed-4342ee88aa3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-quobyte-2bb8f9a5-237e-4fec-99ed-4342ee88aa3c" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-2bb8f9a5-237e-4fec-99ed-4342ee88aa3c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Deleting offline snapshot 2bb8f9a5-237e-4fec-99ed-4342ee88aa3c of volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] snapshot_file for this snap is: volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[096a9e98-9c70-4784-810f-b5f6d780bf5f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:18 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c Jul 06 12:27:18 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:18 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659" returned: 0 in 0.855s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:27:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:27:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a7b8cc-f0c6-43fc-bfe9-3a025e47be1b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:18 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 Jul 06 12:27:18 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:18 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c" returned: 0 in 0.898s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8a4f32-f3c7-4276-962b-60d9a8a0cdfd]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:19 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:19 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:19 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" returned: 0 in 0.850s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:19 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:27:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:19 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c Jul 06 12:27:19 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:19 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 0.816s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:19 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c Jul 06 12:27:19 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:21 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c" returned: 0 in 1.685s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:21 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c Jul 06 12:27:21 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:22 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.2bb8f9a5-237e-4fec-99ed-4342ee88aa3c" returned: 0 in 1.576s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-2bb8f9a5-237e-4fec-99ed-4342ee88aa3c" released by "_delete_snapshot" :: held 5.137s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" released by "delete_snapshot" :: held 5.174s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:23 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Created reservations ['68091e68-a2ff-4edb-abbd-8f400918cfff', 'e86544fc-ae3d-4fbd-949a-57824b262445', 'a96ed819-9dd1-4ad4-8d5e-48085ec83eb1', 'fc8fbe3f-2ff9-4a8c-ab29-e40fb1e23ed3'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:27:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Delete snapshot completed successfully. Jul 06 12:27:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce7b224e-e79f-44d8-963b-f7b1e46f0278 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-2bb8f9a5-237e-4fec-99ed-4342ee88aa3c-delete_snapshot" released by "delete_snapshot" :: held 5.670s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:26 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c" returned: 0 in 7.019s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8abb6bd-b82c-43a5-a973-0730a8016b47]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:26 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 Jul 06 12:27:26 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:27 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" returned: 0 in 1.187s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:27 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:27:27 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Converted 1024.00 MB image at 145.88 MB/s Jul 06 12:27:27 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c is being set with open permissions: ugo+rw Jul 06 12:27:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:27 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c Jul 06 12:27:27 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:28 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c" returned: 0 in 0.797s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-a76af29c-8360-4653-ab8b-664c6c28b65c" released by "_copy_volume_from_snapshot" :: held 10.820s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-ac802933-2d59-4ff6-a556-85ad41832659-a76af29c-8360-4653-ab8b-664c6c28b65c" released by "_create_volume_from_snapshot" :: held 10.868s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.896s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.599s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] Creating offline snapshot 52f2c883-a56b-4dfc-9a37-6b841164170b of volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae162d2-3e9e-4030-ba52-c375877edfb2]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb54d9b-748a-453a-83e1-6aa9a63732fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76af29c-8360-4653-ab8b-664c6c28b65c', 'volume_size': 1, 'snapshot_id': 'ac802933-2d59-4ff6-a556-85ad41832659'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843739ea-9982-449c-a674-a774c4cd4dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:27:28 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Volume volume-a76af29c-8360-4653-ab8b-664c6c28b65c (a76af29c-8360-4653-ab8b-664c6c28b65c): created successfully Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843739ea-9982-449c-a674-a774c4cd4dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:27:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Flow 'volume_create_manager' (8e8b9b83-8625-4ba8-860c-b92adfc48bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:27:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-60ca7991-f13c-4d3c-817f-a266577ce14a tempest-TestStampPattern-1605817143 None] Created volume successfully. Jul 06 12:27:28 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:28 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:29 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 0.937s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:29 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b 1G Jul 06 12:27:29 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:30 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b 1G" returned: 0 in 1.003s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:30 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b Jul 06 12:27:30 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:31 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b" returned: 0 in 0.909s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:31 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b is being set with open permissions: ugo+rw Jul 06 12:27:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:31 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b Jul 06 12:27:31 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:31 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b" returned: 0 in 0.705s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:31 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=68,cinder:SELECT=60,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:27:31 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=75,cinder:UPDATE=57,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:27:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.695s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c3749aab-abcd-4f1e-b1e3-4e2ed118e450 tempest-SnapshotsActionsTest-1419269836 None] Create snapshot completed successfully Jul 06 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:27:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:32 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:27:32 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-52f2c883-a56b-4dfc-9a37-6b841164170b-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-52f2c883-a56b-4dfc-9a37-6b841164170b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-quobyte-52f2c883-a56b-4dfc-9a37-6b841164170b" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-52f2c883-a56b-4dfc-9a37-6b841164170b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Deleting offline snapshot 52f2c883-a56b-4dfc-9a37-6b841164170b of volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] snapshot_file for this snap is: volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5393ff32-ebba-46eb-8e85-d294091c2d14]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:33 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b Jul 06 12:27:33 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:33 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.078s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:27:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:27:34 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b" returned: 0 in 1.091s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5f7a43-1643-4b59-bee9-f0e616b484f6]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:34 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:34 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:35 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 1.112s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:35 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b Jul 06 12:27:35 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:36 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b" returned: 0 in 1.088s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:36 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b Jul 06 12:27:36 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:37 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.52f2c883-a56b-4dfc-9a37-6b841164170b" returned: 0 in 0.823s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-52f2c883-a56b-4dfc-9a37-6b841164170b" released by "_delete_snapshot" :: held 4.247s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" released by "delete_snapshot" :: held 4.277s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:37 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Created reservations ['3525491d-5492-42c0-ab4b-065ec0e28e87', '185800c0-0ae0-4544-86f8-b1d6d710023b', 'ae6b6b46-0759-4dd0-807c-a4d8232c4846', '780e0fc5-e6ab-485b-ad4c-45088c2dbbb7'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:27:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Delete snapshot completed successfully. Jul 06 12:27:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-422dbe31-2a3d-4d66-aa1c-b09f904af240 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-52f2c883-a56b-4dfc-9a37-6b841164170b-delete_snapshot" released by "delete_snapshot" :: held 4.504s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] Creating offline snapshot 6074ee5e-594e-4275-8ba0-d2b4b04f3bde of volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:27:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6043e8-a43e-4342-b4ef-85bc13d60664]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:39 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:39 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:40 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 1.039s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:40 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde 1G Jul 06 12:27:40 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:40 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde 1G" returned: 0 in 0.897s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:40 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde Jul 06 12:27:40 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:41 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde" returned: 0 in 0.722s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:41 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde is being set with open permissions: ugo+rw Jul 06 12:27:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:41 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde Jul 06 12:27:41 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:42 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde" returned: 0 in 0.789s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.570s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-68a12c88-b601-45b5-960a-10dbdfafc69b tempest-SnapshotsActionsTest-1419269836 None] Create snapshot completed successfully Jul 06 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-6074ee5e-594e-4275-8ba0-d2b4b04f3bde-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-6074ee5e-594e-4275-8ba0-d2b4b04f3bde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-quobyte-6074ee5e-594e-4275-8ba0-d2b4b04f3bde" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-6074ee5e-594e-4275-8ba0-d2b4b04f3bde" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Deleting offline snapshot 6074ee5e-594e-4275-8ba0-d2b4b04f3bde of volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:27:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] snapshot_file for this snap is: volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:27:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1882c8ec-ea8b-4ec7-980d-28b2061ce1ce]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:43 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde Jul 06 12:27:43 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:44 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde" returned: 0 in 0.772s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f88383-70de-4f24-a0d4-ac0de8385bf1]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:44 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:44 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:44 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 0.844s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:45 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde Jul 06 12:27:45 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:45 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde" returned: 0 in 0.902s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:45 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde Jul 06 12:27:45 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:46 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.6074ee5e-594e-4275-8ba0-d2b4b04f3bde" returned: 0 in 0.747s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-6074ee5e-594e-4275-8ba0-d2b4b04f3bde" released by "_delete_snapshot" :: held 3.377s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" released by "delete_snapshot" :: held 3.411s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Created reservations ['85dbd029-ac1f-4d8b-93be-68cbb45fd4e4', '4fe3da66-4438-47e7-b285-4e640ab869b1', '8ef4b821-4c20-4a6d-91e0-e78432be87c6', '2f774fd9-0075-48f6-ad0a-b042325941fb'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:27:46 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Delete snapshot completed successfully. Jul 06 12:27:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1fd43e41-9668-4189-8ab1-e07b4a4aac83 tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-6074ee5e-594e-4275-8ba0-d2b4b04f3bde-delete_snapshot" released by "delete_snapshot" :: held 3.606s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:27:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:27:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] Creating offline snapshot aa587eff-6d25-4d2b-83bb-4138d96572de of volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:27:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6644f0ef-077c-48b6-8c94-7f8c06f15ff6]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:47 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:47 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:48 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 0.869s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:48 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de 1G Jul 06 12:27:48 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:49 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de 1G" returned: 0 in 0.926s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:49 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de Jul 06 12:27:49 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:50 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de" returned: 0 in 0.706s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:50 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de is being set with open permissions: ugo+rw Jul 06 12:27:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:50 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de Jul 06 12:27:50 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:51 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de" returned: 0 in 0.670s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.274s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:27:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-64b726ad-fde7-42e6-b375-bc8f41d7d6d9 tempest-SnapshotsActionsTest-1419269836 None] Create snapshot completed successfully Jul 06 12:27:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-aa587eff-6d25-4d2b-83bb-4138d96572de-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-aa587eff-6d25-4d2b-83bb-4138d96572de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Acquiring lock "cinder-quobyte-aa587eff-6d25-4d2b-83bb-4138d96572de" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-aa587eff-6d25-4d2b-83bb-4138d96572de" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Deleting offline snapshot aa587eff-6d25-4d2b-83bb-4138d96572de of volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:27:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] snapshot_file for this snap is: volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:27:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[196bd624-ce6c-4e70-aa67-883304054b7e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:52 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de Jul 06 12:27:52 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:53 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de" returned: 0 in 0.819s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d9e32b-6b6a-4413-9deb-8588f017c4b6]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:53 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:53 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:53 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 0.820s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:53 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de Jul 06 12:27:53 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:54 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de" returned: 0 in 0.794s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:54 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de Jul 06 12:27:54 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:55 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.aa587eff-6d25-4d2b-83bb-4138d96572de" returned: 0 in 0.683s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-aa587eff-6d25-4d2b-83bb-4138d96572de" released by "_delete_snapshot" :: held 3.234s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" released by "delete_snapshot" :: held 3.264s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:55 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Created reservations ['6fc2039d-0dd1-48b1-89d9-d11bc26f2d92', '2afa6102-8750-4598-93df-ce5a0162326c', '12238c69-2dbd-4bf0-aab4-6559bd1de663', 'ff25ab8e-7f56-4a9c-8ffc-3eb53673605e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:27:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Delete snapshot completed successfully. Jul 06 12:27:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a01d6c2-05d7-40b4-b137-fcd600f473cc tempest-SnapshotsActionsTest-248427386 None] Lock "cinder-aa587eff-6d25-4d2b-83bb-4138d96572de-delete_snapshot" released by "delete_snapshot" :: held 3.422s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "cinder-fb412597-d724-4531-9890-f04f8f3ca507-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Lock "cinder-fb412597-d724-4531-9890-f04f8f3ca507-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "cinder-quobyte-fb412597-d724-4531-9890-f04f8f3ca507" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Lock "cinder-quobyte-fb412597-d724-4531-9890-f04f8f3ca507" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Deleting offline snapshot fb412597-d724-4531-9890-f04f8f3ca507 of volume f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:27:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] snapshot_file for this snap is: volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:27:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5cea57-4b8b-4eff-a59d-bd25d73659f7]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:56 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:56 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:57 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 0.842s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:27:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e30cf3-26eb-4f45-9939-f103a0272f00]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:27:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:57 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 Jul 06 12:27:57 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:58 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" returned: 0 in 0.948s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:58 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:58 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:27:59 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 06 12:27:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 0.880s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:27:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:27:59 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507 Jul 06 12:27:59 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:00 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14.fb412597-d724-4531-9890-f04f8f3ca507" returned: 0 in 0.773s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Lock "cinder-quobyte-fb412597-d724-4531-9890-f04f8f3ca507" released by "_delete_snapshot" :: held 3.553s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" released by "delete_snapshot" :: held 3.576s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:00 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Created reservations ['5fdf6dfe-ee05-48d8-b27c-f1b208cb76d4', '1353d829-f70f-42b8-a750-e6415c561038', '82c3a8ae-6d31-47d2-b315-4bafe8d346e9', '211ee8cb-d310-434c-b723-05b06f13ea46'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Delete snapshot completed successfully. Jul 06 12:28:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-731eb468-ced4-4dbe-94c5-3aa14ae8dc21 tempest-SnapshotsActionsTest-1419269836 None] Lock "cinder-fb412597-d724-4531-9890-f04f8f3ca507-delete_snapshot" released by "delete_snapshot" :: held 3.770s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "cinder-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Lock "cinder-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de68f5a-0d1c-4a1a-b02a-32e85d0f0732]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:01 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 Jul 06 12:28:01 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:02 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" returned: 0 in 0.861s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:02 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14 Jul 06 12:28:02 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:02 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" returned: 0 in 0.760s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Lock "cinder-quobyte-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14" released by "delete_volume" :: held 1.708s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:02 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Created reservations ['06954e8d-427e-4710-a522-8c4f58265a30', '92e98d14-19fe-4804-811b-dc775bb60080', '694b1355-ad08-48de-8880-0d57a9c264cf', '9768dd33-d5a1-47ed-afc9-87a77f5f298a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:03 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:28:03 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:03 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.727s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:03 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Deleted volume successfully. Jul 06 12:28:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ff84bf2f-77a4-4377-bf4f-434a656e7ae6 tempest-SnapshotsActionsTest-1419269836 None] Lock "cinder-f9b85554-fe3d-4d7a-94a6-ef4cf189ac14-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-6d5d51c9-ec38-41ba-97eb-c3da1195a588 req-c91da216-934a-4141-ba3c-485095f625c3 tempest-TestStampPattern-1605817143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-6d5d51c9-ec38-41ba-97eb-c3da1195a588 req-c91da216-934a-4141-ba3c-485095f625c3 tempest-TestStampPattern-1605817143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a4f95-2cd7-471c-acff-795919fb044c]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-6d5d51c9-ec38-41ba-97eb-c3da1195a588 req-c91da216-934a-4141-ba3c-485095f625c3 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:04 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c Jul 06 12:28:04 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:05 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-6d5d51c9-ec38-41ba-97eb-c3da1195a588 req-c91da216-934a-4141-ba3c-485095f625c3 tempest-TestStampPattern-1605817143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c" returned: 0 in 0.911s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-6d5d51c9-ec38-41ba-97eb-c3da1195a588 req-c91da216-934a-4141-ba3c-485095f625c3 tempest-TestStampPattern-1605817143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.929s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-6d5d51c9-ec38-41ba-97eb-c3da1195a588 req-c91da216-934a-4141-ba3c-485095f625c3 tempest-TestStampPattern-1605817143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-a76af29c-8360-4653-ab8b-664c6c28b65c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d16e871-6d54-48f0-a4cf-d6aedea0a29c', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:28:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-6d5d51c9-ec38-41ba-97eb-c3da1195a588 req-c91da216-934a-4141-ba3c-485095f625c3 tempest-TestStampPattern-1605817143 None] attachment_update completed successfully. Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Flow 'volume_create_manager' (6596a7e1-8de9-42a3-8408-c014ed2e1b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afae198-54c4-46d7-983f-1130825b96fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8afae198-54c4-46d7-983f-1130825b96fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1597276090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b08f90-b1f2-4ac9-b955-e33690dc0e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a3df8c70043aca524dc79a538de38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:09Z,use_quota=True,user_id='b208dcebb55547609f036ffb3ddb7d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a98fb107-6f82-465a-b66b-7e98bb3669a1),volume_type_id=a98fb107-6f82-465a-b66b-7e98bb3669a1)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a318a46-8c0e-4298-a1da-da800ed03320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a318a46-8c0e-4298-a1da-da800ed03320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4955b94c-e0a9-47a8-8168-12a86fe54a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4955b94c-e0a9-47a8-8168-12a86fe54a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4b08f90-b1f2-4ac9-b955-e33690dc0e02', 'volume_name': 'volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e257756-2ff6-4c8a-98f9-6b70b805de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e257756-2ff6-4c8a-98f9-6b70b805de58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29d7eb6-b8d3-4479-b747-2ff68fb0370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Volume b4b08f90-b1f2-4ac9-b955-e33690dc0e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02', 'volume_size': 1} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1597276090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b08f90-b1f2-4ac9-b955-e33690dc0e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a3df8c70043aca524dc79a538de38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:09Z,use_quota=True,user_id='b208dcebb55547609f036ffb3ddb7d84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a98fb107-6f82-465a-b66b-7e98bb3669a1),volume_type_id=a98fb107-6f82-465a-b66b-7e98bb3669a1)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Creating volume b4b08f90-b1f2-4ac9-b955-e33690dc0e02 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:28:09 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:28:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:09 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02 1073741824 Jul 06 12:28:09 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:10 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02 1073741824" returned: 0 in 0.961s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:10 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02 Jul 06 12:28:10 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:11 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02" returned: 0 in 0.706s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29d7eb6-b8d3-4479-b747-2ff68fb0370f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02757593-0588-4903-8a23-92ca7e5be40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:11 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Volume volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02 (b4b08f90-b1f2-4ac9-b955-e33690dc0e02): created successfully Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02757593-0588-4903-8a23-92ca7e5be40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Flow 'volume_create_manager' (6596a7e1-8de9-42a3-8408-c014ed2e1b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-edce26be-020d-4400-b1f7-728f35aa33be tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Created volume successfully. Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7b443a78-b03c-43ad-ab7b-e98e9d57d100 tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7b443a78-b03c-43ad-ab7b-e98e9d57d100 tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7b443a78-b03c-43ad-ab7b-e98e9d57d100 tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7b443a78-b03c-43ad-ab7b-e98e9d57d100 tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7b443a78-b03c-43ad-ab7b-e98e9d57d100 tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7b443a78-b03c-43ad-ab7b-e98e9d57d100 tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:11 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:28:11 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:12 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7b443a78-b03c-43ad-ab7b-e98e9d57d100 tempest-VolumeRetypeWithoutMigrationTest-893286514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.693s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:12 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-7b443a78-b03c-43ad-ab7b-e98e9d57d100 tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7b443a78-b03c-43ad-ab7b-e98e9d57d100 tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Retype volume completed successfully. Jul 06 12:28:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-71424e18-7ffb-42ff-b088-9a1d409a7f41 req-5241897a-2925-4149-b174-e8957e6da413 tempest-TestStampPattern-1605817143 None] Terminate volume connection completed successfully. Jul 06 12:28:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-71424e18-7ffb-42ff-b088-9a1d409a7f41 req-5241897a-2925-4149-b174-e8957e6da413 tempest-TestStampPattern-1605817143 None] Deleting attachment 4d16e871-6d54-48f0-a4cf-d6aedea0a29c. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:28:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Acquiring lock "cinder-b4b08f90-b1f2-4ac9-b955-e33690dc0e02-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "cinder-b4b08f90-b1f2-4ac9-b955-e33690dc0e02-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Acquiring lock "cinder-quobyte-b4b08f90-b1f2-4ac9-b955-e33690dc0e02" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "cinder-quobyte-b4b08f90-b1f2-4ac9-b955-e33690dc0e02" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13ec772-5511-4667-8939-2789e496a063]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:13 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02 Jul 06 12:28:13 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:13 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02" returned: 0 in 0.874s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:14 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02 Jul 06 12:28:14 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:14 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b4b08f90-b1f2-4ac9-b955-e33690dc0e02" returned: 0 in 0.752s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "cinder-quobyte-b4b08f90-b1f2-4ac9-b955-e33690dc0e02" released by "delete_volume" :: held 1.666s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:14 devstack cinder-volume[86561]: WARNING cinder.quota [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:28:14 devstack cinder-volume[86561]: WARNING cinder.quota [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 12:28:14 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Created reservations ['7c63bb8b-eaf6-4c46-ba2f-38904a848a1b', 'c4502b0c-5b52-49bd-bdb9-df7be755e6e5', 'f92661d8-122e-4b98-a6ce-8a034e03e005', '090e0475-dbc2-4193-a8e9-206764234cc5'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:14 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:28:14 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:15 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.816s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:15 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Deleted volume successfully. Jul 06 12:28:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3887e452-f1ea-4ef6-9736-d97346728a3e tempest-VolumeRetypeWithoutMigrationTest-893286514 None] Lock "cinder-b4b08f90-b1f2-4ac9-b955-e33690dc0e02-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Flow 'volume_create_manager' (aaad6d40-9e24-4565-ae6c-ffa791446ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a16ce0-7007-4ea9-bd0f-eaea384ea959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a16ce0-7007-4ea9-bd0f-eaea384ea959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-682514832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e82b450-8e96-48d0-b327-723103e2e7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a08fd0a16f4656a322881fbe7a4086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:22Z,use_quota=True,user_id='9d69aa5ea9004be284261e3559b8f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c55e437-167b-4e57-a99e-2afc0cc5db29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c55e437-167b-4e57-a99e-2afc0cc5db29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8903e7c-993c-492e-85d7-0f3b31e54149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8903e7c-993c-492e-85d7-0f3b31e54149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e82b450-8e96-48d0-b327-723103e2e7d1', 'volume_name': 'volume-9e82b450-8e96-48d0-b327-723103e2e7d1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9d577a-7507-44a0-83bf-447c67eeddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9d577a-7507-44a0-83bf-447c67eeddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad3d739-af7e-4c2c-a55e-05ce62efe666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Volume 9e82b450-8e96-48d0-b327-723103e2e7d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e82b450-8e96-48d0-b327-723103e2e7d1', 'volume_size': 1} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-682514832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e82b450-8e96-48d0-b327-723103e2e7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a08fd0a16f4656a322881fbe7a4086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:22Z,use_quota=True,user_id='9d69aa5ea9004be284261e3559b8f392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Creating volume 9e82b450-8e96-48d0-b327-723103e2e7d1 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:28:22 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:28:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:22 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 1073741824 Jul 06 12:28:22 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:23 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 1073741824" returned: 0 in 0.828s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:23 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 Jul 06 12:28:23 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Acquiring lock "cinder-a76af29c-8360-4653-ab8b-664c6c28b65c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Lock "cinder-a76af29c-8360-4653-ab8b-664c6c28b65c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Acquiring lock "cinder-quobyte-a76af29c-8360-4653-ab8b-664c6c28b65c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-a76af29c-8360-4653-ab8b-664c6c28b65c" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[840650bf-d041-45c5-89a7-b21ec2d52c11]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:23 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c Jul 06 12:28:23 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:24 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1" returned: 0 in 0.785s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad3d739-af7e-4c2c-a55e-05ce62efe666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e82b450-8e96-48d0-b327-723103e2e7d1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7782a55-3dcf-454f-81f9-dfffc03d5d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:24 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Volume volume-9e82b450-8e96-48d0-b327-723103e2e7d1 (9e82b450-8e96-48d0-b327-723103e2e7d1): created successfully Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7782a55-3dcf-454f-81f9-dfffc03d5d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Flow 'volume_create_manager' (aaad6d40-9e24-4565-ae6c-ffa791446ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0a013c5f-b529-4911-8a37-ad9d47b661b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Created volume successfully. Jul 06 12:28:24 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c" returned: 0 in 0.860s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:24 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c Jul 06 12:28:24 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Creating offline snapshot eb9956df-98a5-4de2-b9f0-d8efbc96ca12 of volume 9e82b450-8e96-48d0-b327-723103e2e7d1 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[078adffc-a118-466c-aaa7-a95fbacef804]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:24 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 Jul 06 12:28:24 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:25 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a76af29c-8360-4653-ab8b-664c6c28b65c" returned: 0 in 0.762s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-a76af29c-8360-4653-ab8b-664c6c28b65c" released by "delete_volume" :: held 1.678s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Created reservations ['45fae9b3-98c8-4892-a98e-76664b282651', 'c4d3065c-a3b5-44f6-a8ba-61220f0322a5', '078146b4-654b-45ce-b85e-d4b20ca0d6ac', 'f8b449be-79e4-462d-869d-77dedf3bf8d6'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:25 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:28:25 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:25 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1" returned: 0 in 0.999s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:25 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 1G Jul 06 12:28:25 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Acquiring lock "cinder-ac802933-2d59-4ff6-a556-85ad41832659-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Lock "cinder-ac802933-2d59-4ff6-a556-85ad41832659-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Acquiring lock "cinder-quobyte-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Acquiring lock "cinder-quobyte-ac802933-2d59-4ff6-a556-85ad41832659" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-ac802933-2d59-4ff6-a556-85ad41832659" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Deleting offline snapshot ac802933-2d59-4ff6-a556-85ad41832659 of volume 24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] snapshot_file for this snap is: volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d547033c-92fa-4bd6-96ba-0da1f424e6b5]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:26 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.905s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Deleted volume successfully. Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-87eba2d8-a35c-4adc-82da-b576ebdbab4a tempest-TestStampPattern-1605817143 None] Lock "cinder-a76af29c-8360-4653-ab8b-664c6c28b65c-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:26 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 Jul 06 12:28:26 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:26 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 1G" returned: 0 in 0.984s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e82b450-8e96-48d0-b327-723103e2e7d1 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:26 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e82b450-8e96-48d0-b327-723103e2e7d1 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 Jul 06 12:28:26 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:27 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659" returned: 0 in 0.901s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:28:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c663147-838f-4f96-91cf-613fdb0f3693]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:27 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 Jul 06 12:28:27 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:27 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e82b450-8e96-48d0-b327-723103e2e7d1 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12" returned: 0 in 0.859s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:27 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 is being set with open permissions: ugo+rw Jul 06 12:28:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:27 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 Jul 06 12:28:27 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:28 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" returned: 0 in 0.882s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:28 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 Jul 06 12:28:28 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:28 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12" returned: 0 in 0.737s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:28 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.info Jul 06 12:28:28 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:29 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659" returned: 0 in 0.808s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:29 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659 Jul 06 12:28:29 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:29 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.info" returned: 0 in 0.755s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:29 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.info is being set with open permissions: ugo+rw Jul 06 12:28:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:29 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.info Jul 06 12:28:29 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:29 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8.ac802933-2d59-4ff6-a556-85ad41832659" returned: 0 in 0.731s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-ac802933-2d59-4ff6-a556-85ad41832659" released by "_delete_snapshot" :: held 3.450s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" released by "delete_snapshot" :: held 3.484s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:29 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Created reservations ['cdbe9330-77da-4715-b422-26029d977a07', '998e5c06-2702-4279-9f3d-cc472619c90e', 'd12d1995-d703-4a1d-8afc-b5c477699163', 'e63083b6-e854-4da4-9bd1-8c47ecbce024'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:29 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.info" returned: 0 in 0.691s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.137s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6e4f4d3e-37d3-4b08-ab53-e79aec9eb286 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Create snapshot completed successfully Jul 06 12:28:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Delete snapshot completed successfully. Jul 06 12:28:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6463c5fe-4818-416a-a443-8471522e578c tempest-TestStampPattern-1605817143 None] Lock "cinder-ac802933-2d59-4ff6-a556-85ad41832659-delete_snapshot" released by "delete_snapshot" :: held 3.691s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Acquiring lock "cinder-eb9956df-98a5-4de2-b9f0-d8efbc96ca12-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "cinder-eb9956df-98a5-4de2-b9f0-d8efbc96ca12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Acquiring lock "cinder-quobyte-9e82b450-8e96-48d0-b327-723103e2e7d1" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "cinder-quobyte-9e82b450-8e96-48d0-b327-723103e2e7d1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Acquiring lock "cinder-quobyte-eb9956df-98a5-4de2-b9f0-d8efbc96ca12" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "cinder-quobyte-eb9956df-98a5-4de2-b9f0-d8efbc96ca12" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Deleting offline snapshot eb9956df-98a5-4de2-b9f0-d8efbc96ca12 of volume 9e82b450-8e96-48d0-b327-723103e2e7d1 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:28:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] snapshot_file for this snap is: volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:28:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9408b78d-9432-44fd-ab1d-ae2d1cdbe917]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:32 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 Jul 06 12:28:32 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:32 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12" returned: 0 in 0.898s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e82b450-8e96-48d0-b327-723103e2e7d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:28:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a76f163-da6d-4f5c-8b12-8154638d910d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:28:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:32 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:28:32 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:32 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 Jul 06 12:28:32 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:33 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.932s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:28:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:28:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:28:33 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1" returned: 0 in 1.036s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:33 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 Jul 06 12:28:33 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:34 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12" returned: 0 in 0.875s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:34 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12 Jul 06 12:28:34 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:35 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1.eb9956df-98a5-4de2-b9f0-d8efbc96ca12" returned: 0 in 0.752s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:35 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=76,cinder:UPDATE=76,cinder:DELETE=2,cinder:INSERT=15 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:28:35 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=58,cinder:INSERT=20,cinder:UPDATE=59,cinder:DELETE=7 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:28:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "cinder-quobyte-eb9956df-98a5-4de2-b9f0-d8efbc96ca12" released by "_delete_snapshot" :: held 3.691s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "cinder-quobyte-9e82b450-8e96-48d0-b327-723103e2e7d1" released by "delete_snapshot" :: held 3.727s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:35 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Created reservations ['1e5218c2-0b80-4b12-bbca-c9b856c4ad9b', 'c3adbb7e-4bd3-4b7a-b2d5-c6bef0d23821', '2e3c81ce-ba92-45c8-8148-30fb7fac172c', '81bd974a-9ee3-46d1-9782-6afc253f885d'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Delete snapshot completed successfully. Jul 06 12:28:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-570ed3e3-1738-4caf-9a4f-c1a8108382ea tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "cinder-eb9956df-98a5-4de2-b9f0-d8efbc96ca12-delete_snapshot" released by "delete_snapshot" :: held 3.902s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Acquiring lock "cinder-9e82b450-8e96-48d0-b327-723103e2e7d1-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "cinder-9e82b450-8e96-48d0-b327-723103e2e7d1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Acquiring lock "cinder-quobyte-9e82b450-8e96-48d0-b327-723103e2e7d1" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "cinder-quobyte-9e82b450-8e96-48d0-b327-723103e2e7d1" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7507142-1364-4b86-901c-fd5a26318d66]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:36 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 Jul 06 12:28:36 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:37 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1" returned: 0 in 0.860s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:37 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1 Jul 06 12:28:37 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:37 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-9e82b450-8e96-48d0-b327-723103e2e7d1" returned: 0 in 0.726s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "cinder-quobyte-9e82b450-8e96-48d0-b327-723103e2e7d1" released by "delete_volume" :: held 1.650s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:37 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Created reservations ['cf72e6b6-522c-4cdd-bad1-744b876783f1', 'c7da9474-d7cc-4606-b9c5-04ee64787392', '1ca9693d-4d30-4d95-88b8-4a0265296fc7', '458bb880-ab63-496d-90ee-0c17fca07e94'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:38 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:28:38 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:38 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.750s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:38 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Deleted volume successfully. Jul 06 12:28:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d74d7079-03e1-4ade-9f28-fd2802a28625 tempest-VolumeSnapshotQuotasNegativeTestJSON-76479376 None] Lock "cinder-9e82b450-8e96-48d0-b327-723103e2e7d1-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Acquiring lock "cinder-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Lock "cinder-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Acquiring lock "cinder-quobyte-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:28:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:28:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ac0312-9168-49da-9731-e8d864ff141b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:39 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 Jul 06 12:28:39 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:40 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" returned: 0 in 0.937s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:40 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8 Jul 06 12:28:40 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:41 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" returned: 0 in 0.725s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Lock "cinder-quobyte-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8" released by "delete_volume" :: held 1.735s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:41 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Created reservations ['66a8f62a-1c60-47c1-b7f2-3dcc6d8953f2', '51ee2d23-9799-4449-948f-ac0a3bc8495a', '2003d383-cba0-4786-84c1-e86a87f15e97', '99151abe-a6b7-41a6-a44b-0be139525a0c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:28:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:28:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:28:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:28:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:28:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:28:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:41 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:28:41 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:28:42 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Jul 06 12:28:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.932s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:28:42 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:28:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Deleted volume successfully. Jul 06 12:28:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9f99062a-bf8d-4ef1-bf7c-fbe64db471e2 tempest-TestStampPattern-1605817143 None] Lock "cinder-24c4b4ca-6fe5-4e2a-aac4-0de7d21695e8-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:28:51 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=18,cinder:INSERT=7,cinder:UPDATE=21 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:28:52 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:28:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:28:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Flow 'volume_create_manager' (3021dc11-fe50-4df6-bce3-d89c12742319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:28:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc1d358-17a7-48ed-bec2-68fb2a90235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc1d358-17a7-48ed-bec2-68fb2a90235c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b852f3-e19d-4090-92a8-9f8a515d0a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c1f29bd9c24910b380873d6d2b27ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:59Z,use_quota=True,user_id='73239eedc0b24aeaaa578f800739d897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a07696-5205-4ff5-bc19-62728ba41c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a07696-5205-4ff5-bc19-62728ba41c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1f58f4-7bfe-4b28-b882-6178ddfe712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:58 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:28:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1f58f4-7bfe-4b28-b882-6178ddfe712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98b852f3-e19d-4090-92a8-9f8a515d0a58', 'volume_name': 'volume-98b852f3-e19d-4090-92a8-9f8a515d0a58', 'volume_size': 1, 'image_id': '4811045a-235d-46a1-86ea-d225a63fdff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4811045a-235d-46a1-86ea-d225a63fdff1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5218775359705bf958958aa839f6dad4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10c1f29bd9c24910b380873d6d2b27ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'efa954045559c92b5fa51aaf26ac17b423a87a28a5c7da9c4a0fa97dd2febee4cdc90c9c6af7300c348228232e5352aabf7ad66aaed53ff791e20befe4f3445b', 'id': '4811045a-235d-46a1-86ea-d225a63fdff1', 'created_at': datetime.datetime(2026, 7, 6, 10, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 28, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4811045a-235d-46a1-86ea-d225a63fdff1/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b0ad05-3149-4737-9840-d4519e21d05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b0ad05-3149-4737-9840-d4519e21d05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:28:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5303d19b-d423-4cf9-88e2-b85f0890c63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:28:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Volume 98b852f3-e19d-4090-92a8-9f8a515d0a58: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98b852f3-e19d-4090-92a8-9f8a515d0a58', 'volume_size': 1, 'image_id': '4811045a-235d-46a1-86ea-d225a63fdff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4811045a-235d-46a1-86ea-d225a63fdff1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5218775359705bf958958aa839f6dad4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10c1f29bd9c24910b380873d6d2b27ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'efa954045559c92b5fa51aaf26ac17b423a87a28a5c7da9c4a0fa97dd2febee4cdc90c9c6af7300c348228232e5352aabf7ad66aaed53ff791e20befe4f3445b', 'id': '4811045a-235d-46a1-86ea-d225a63fdff1', 'created_at': datetime.datetime(2026, 7, 6, 10, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 28, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4811045a-235d-46a1-86ea-d225a63fdff1/file', 'properties': {}}, 'image_service': } Jul 06 12:28:59 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Trying to clone 98b852f3-e19d-4090-92a8-9f8a515d0a58 from image 4811045a-235d-46a1-86ea-d225a63fdff1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4811045a-235d-46a1-86ea-d225a63fdff1', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:28:59 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:28:59 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:28:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[01040f52-e97b-476a-9d43-7c0630279e09]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:28:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:28:59 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD Jul 06 12:28:59 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:00 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD" returned: 0 in 0.878s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:00 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD Jul 06 12:29:00 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:01 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD" returned: 1 in 0.863s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:01 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Temporary image 4811045a-235d-46a1-86ea-d225a63fdff1 is fetched for user 73239eedc0b24aeaaa578f800739d897. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:29:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7809092-db11-4d43-8f8f-9e583b18e84a]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:01 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD Jul 06 12:29:01 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:02 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD" returned: 0 in 0.882s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:02 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD Jul 06 12:29:02 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:03 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD" returned: 1 in 1.007s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b852f3-e19d-4090-92a8-9f8a515d0a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10c1f29bd9c24910b380873d6d2b27ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:28:59Z,use_quota=True,user_id='73239eedc0b24aeaaa578f800739d897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Creating volume 98b852f3-e19d-4090-92a8-9f8a515d0a58 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:03 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:29:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:03 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 1073741824 Jul 06 12:29:03 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:04 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 1073741824" returned: 0 in 0.931s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:04 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 Jul 06 12:29:04 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:05 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58" returned: 0 in 0.687s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Attempting download of 4811045a-235d-46a1-86ea-d225a63fdff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/4811045a-235d-46a1-86ea-d225a63fdff1', 'metadata': {}}])) to volume 98b852f3-e19d-4090-92a8-9f8a515d0a58. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b59bb5-1810-40ce-988b-aa5ebb645d2f]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4811045a-235d-46a1-86ea-d225a63fdff1_txjiwgv4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:05 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4811045a-235d-46a1-86ea-d225a63fdff1_txjiwgv4 Jul 06 12:29:05 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Flow 'volume_create_manager' (709853a4-520e-4451-bad5-234efe00de84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49fce48-1f5c-4dca-bc64-a860526a72db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49fce48-1f5c-4dca-bc64-a860526a72db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-389657121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afec2a4-993e-49ba-b462-70176f3b6a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e75a955d5549a8bd693422bcaa47f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:05Z,use_quota=True,user_id='7114ae59ac4a4164b2b7a73b7fdc5071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c94b7c8-6eea-4437-a044-c3c6194cae3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c94b7c8-6eea-4437-a044-c3c6194cae3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74d19b5-4161-4617-9e6d-abcb4af1909d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74d19b5-4161-4617-9e6d-abcb4af1909d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6afec2a4-993e-49ba-b462-70176f3b6a32', 'volume_name': 'volume-6afec2a4-993e-49ba-b462-70176f3b6a32', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87875c77-745f-4b6c-bcd7-8c35d026e9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87875c77-745f-4b6c-bcd7-8c35d026e9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c36838e7-f07d-47ad-93c9-3ec6d8e12379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Volume 6afec2a4-993e-49ba-b462-70176f3b6a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6afec2a4-993e-49ba-b462-70176f3b6a32', 'volume_size': 1} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-389657121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afec2a4-993e-49ba-b462-70176f3b6a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e75a955d5549a8bd693422bcaa47f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:05Z,use_quota=True,user_id='7114ae59ac4a4164b2b7a73b7fdc5071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Creating volume 6afec2a4-993e-49ba-b462-70176f3b6a32 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:05 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:05 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32 1073741824 Jul 06 12:29:05 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:05 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4811045a-235d-46a1-86ea-d225a63fdff1_txjiwgv4" returned: 0 in 0.818s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4811045a-235d-46a1-86ea-d225a63fdff1_txjiwgv4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:06 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4811045a-235d-46a1-86ea-d225a63fdff1_txjiwgv4 Jul 06 12:29:06 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:06 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32 1073741824" returned: 0 in 0.957s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:06 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32 Jul 06 12:29:06 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:06 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4811045a-235d-46a1-86ea-d225a63fdff1_txjiwgv4" returned: 1 in 0.819s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4811045a-235d-46a1-86ea-d225a63fdff1_txjiwgv4' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c5b6c2-69c0-4707-949c-950f73b4f78d]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:06 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD Jul 06 12:29:06 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:07 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32" returned: 0 in 0.748s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c36838e7-f07d-47ad-93c9-3ec6d8e12379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afec2a4-993e-49ba-b462-70176f3b6a32', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69b21c2-ebe5-49c5-8d0a-ed2953762e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Volume volume-6afec2a4-993e-49ba-b462-70176f3b6a32 (6afec2a4-993e-49ba-b462-70176f3b6a32): created successfully Jul 06 12:29:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69b21c2-ebe5-49c5-8d0a-ed2953762e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Flow 'volume_create_manager' (709853a4-520e-4451-bad5-234efe00de84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a7601b55-d62c-4031-ac7a-aea3d1a7e0a7 tempest-VolumesMetadataTest-1596858121 None] Created volume successfully. Jul 06 12:29:07 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:07 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD Jul 06 12:29:07 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Acquiring lock "cinder-6afec2a4-993e-49ba-b462-70176f3b6a32-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Lock "cinder-6afec2a4-993e-49ba-b462-70176f3b6a32-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Acquiring lock "cinder-quobyte-6afec2a4-993e-49ba-b462-70176f3b6a32" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Lock "cinder-quobyte-6afec2a4-993e-49ba-b462-70176f3b6a32" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b21bdff-7ba2-4578-b3c0-c33e41573168]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:08 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD" returned: 1 in 0.815s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:08 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] 4811045a-235d-46a1-86ea-d225a63fdff1 was raw, converting to raw {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:29:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:08 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 Jul 06 12:29:08 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:08 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32 Jul 06 12:29:08 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:09 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32" returned: 0 in 0.938s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:09 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32 Jul 06 12:29:09 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:09 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58" returned: 0 in 1.004s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:09 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4811045a-235d-46a1-86ea-d225a63fdff1_di3a3hbxdevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:29:09 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:29:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:09 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 1G Jul 06 12:29:09 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:10 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6afec2a4-993e-49ba-b462-70176f3b6a32" returned: 0 in 0.719s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Lock "cinder-quobyte-6afec2a4-993e-49ba-b462-70176f3b6a32" released by "delete_volume" :: held 1.718s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Created reservations ['a235fd1c-dc41-4a9a-83b8-540a5420adc5', '893999cf-d61f-4a6f-b145-514fae0c71d0', '2f717bd4-7750-4ea7-b780-9c475ffe1951', 'b199d984-a699-4e0d-898c-b6ae103429a6'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:10 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:29:10 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:10 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 1G" returned: 0 in 0.948s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc43ddae-489a-4048-a5c0-af7030bbabc9]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:10 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 Jul 06 12:29:10 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:11 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.761s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:11 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Deleted volume successfully. Jul 06 12:29:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-54967762-b7ab-4ee5-9731-711051a48335 tempest-VolumesMetadataTest-1596858121 None] Lock "cinder-6afec2a4-993e-49ba-b462-70176f3b6a32-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:11 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58" returned: 0 in 0.832s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:11 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 Jul 06 12:29:11 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:12 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58" returned: 1 in 0.829s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Downloaded image 4811045a-235d-46a1-86ea-d225a63fdff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/4811045a-235d-46a1-86ea-d225a63fdff1', 'metadata': {}}])) to volume 98b852f3-e19d-4090-92a8-9f8a515d0a58 successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Temporary image 4811045a-235d-46a1-86ea-d225a63fdff1 for user 73239eedc0b24aeaaa578f800739d897 is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Marking volume 98b852f3-e19d-4090-92a8-9f8a515d0a58 as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Copying metadata from image 4811045a-235d-46a1-86ea-d225a63fdff1 to 98b852f3-e19d-4090-92a8-9f8a515d0a58. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Creating volume glance metadata for volume 98b852f3-e19d-4090-92a8-9f8a515d0a58 backed by image 4811045a-235d-46a1-86ea-d225a63fdff1 with: {'image_id': '4811045a-235d-46a1-86ea-d225a63fdff1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5218775359705bf958958aa839f6dad4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5303d19b-d423-4cf9-88e2-b85f0890c63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b852f3-e19d-4090-92a8-9f8a515d0a58', 'volume_size': 1, 'image_id': '4811045a-235d-46a1-86ea-d225a63fdff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4811045a-235d-46a1-86ea-d225a63fdff1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5218775359705bf958958aa839f6dad4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '10c1f29bd9c24910b380873d6d2b27ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'efa954045559c92b5fa51aaf26ac17b423a87a28a5c7da9c4a0fa97dd2febee4cdc90c9c6af7300c348228232e5352aabf7ad66aaed53ff791e20befe4f3445b', 'id': '4811045a-235d-46a1-86ea-d225a63fdff1', 'created_at': datetime.datetime(2026, 7, 6, 10, 28, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 28, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4811045a-235d-46a1-86ea-d225a63fdff1/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06875e2-ff6c-4209-97ea-bf7861faab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Volume volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 (98b852f3-e19d-4090-92a8-9f8a515d0a58): created successfully Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06875e2-ff6c-4209-97ea-bf7861faab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Flow 'volume_create_manager' (3021dc11-fe50-4df6-bce3-d89c12742319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9b95ac26-3c5f-4aeb-be40-49787a681423 tempest-VolumeImageDependencyTests-1909307257 None] Created volume successfully. Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Acquiring lock "cinder-98b852f3-e19d-4090-92a8-9f8a515d0a58-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Lock "cinder-98b852f3-e19d-4090-92a8-9f8a515d0a58-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Acquiring lock "cinder-quobyte-98b852f3-e19d-4090-92a8-9f8a515d0a58" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Lock "cinder-quobyte-98b852f3-e19d-4090-92a8-9f8a515d0a58" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bf5ddd-4792-44ff-a18b-d2bcf1bd306d]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:13 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 Jul 06 12:29:13 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:13 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58" returned: 0 in 0.847s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:13 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 Jul 06 12:29:13 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (35acae4d-f919-4a3e-9945-cd76499b1500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10a53c2-8b34-4cd0-b038-665844ba5075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a10a53c2-8b34-4cd0-b038-665844ba5075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-953268172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32efbb2c-5e83-4775-8734-722bcbe09287,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:14Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70039a34-d504-4b64-aad8-702d0ed34952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70039a34-d504-4b64-aad8-702d0ed34952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12d57ba-2e85-46d7-b263-e351839a3455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12d57ba-2e85-46d7-b263-e351839a3455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32efbb2c-5e83-4775-8734-722bcbe09287', 'volume_name': 'volume-32efbb2c-5e83-4775-8734-722bcbe09287', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe8c7bb-4fd5-4ea9-98f9-9f70aeb8d1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe8c7bb-4fd5-4ea9-98f9-9f70aeb8d1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07dcdf4-c6b4-4e0e-8c45-1a642a104b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:14 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Volume 32efbb2c-5e83-4775-8734-722bcbe09287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32efbb2c-5e83-4775-8734-722bcbe09287', 'volume_size': 1} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-953268172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32efbb2c-5e83-4775-8734-722bcbe09287,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:14Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Creating volume 32efbb2c-5e83-4775-8734-722bcbe09287 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:14 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:14 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287 1073741824 Jul 06 12:29:14 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:14 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58" returned: 1 in 0.967s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:29:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:14 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58 Jul 06 12:29:14 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:15 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287 1073741824" returned: 0 in 1.060s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:15 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287 Jul 06 12:29:15 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:15 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-98b852f3-e19d-4090-92a8-9f8a515d0a58" returned: 0 in 0.826s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Lock "cinder-quobyte-98b852f3-e19d-4090-92a8-9f8a515d0a58" released by "delete_volume" :: held 2.726s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:15 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Created reservations ['6310cc38-a58f-46f3-a67b-33f295f1e917', '7b0ff5db-3832-4f84-bc40-8b7a5d4141b7', 'f8d0e100-3740-48e5-b205-1815e159641b', '2143f087-c8a6-41ce-888f-6e15581ca791'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:15 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:29:15 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:16 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287" returned: 0 in 0.831s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07dcdf4-c6b4-4e0e-8c45-1a642a104b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32efbb2c-5e83-4775-8734-722bcbe09287', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d27c6a-9d80-4198-93e4-cd911600681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:16 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Volume volume-32efbb2c-5e83-4775-8734-722bcbe09287 (32efbb2c-5e83-4775-8734-722bcbe09287): created successfully Jul 06 12:29:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d27c6a-9d80-4198-93e4-cd911600681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:16 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (35acae4d-f919-4a3e-9945-cd76499b1500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bf250584-858d-4840-8aba-25539fc47813 tempest-VolumesGetTest-900190652 None] Created volume successfully. Jul 06 12:29:16 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.858s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:16 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Deleted volume successfully. Jul 06 12:29:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a3afbe10-ba4d-45a8-a2df-17d4dab9c6c3 tempest-VolumeImageDependencyTests-1909307257 None] Lock "cinder-98b852f3-e19d-4090-92a8-9f8a515d0a58-delete_volume" released by "delete_volume" :: held 3.875s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (632dfc10-4d13-4bc8-a190-fdc51fef8e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2a9c39-4f4a-4be7-8a2a-228a35e0fffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2a9c39-4f4a-4be7-8a2a-228a35e0fffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1161072447',display_name='tempest-VolumesGetTest-Volume-1171132458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd637d2a-bd46-48ab-ae07-4057365edfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:18Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8975ddd5-20c0-4040-9d97-5cd534c249ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8975ddd5-20c0-4040-9d97-5cd534c249ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac35b975-24b6-486a-9640-a1f9ffd4ae2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac35b975-24b6-486a-9640-a1f9ffd4ae2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd637d2a-bd46-48ab-ae07-4057365edfc1', 'volume_name': 'volume-fd637d2a-bd46-48ab-ae07-4057365edfc1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2436f452-9d37-4d9a-b680-cfa97e72eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2436f452-9d37-4d9a-b680-cfa97e72eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a728b14-4b76-4f8f-a260-8019dc0d86f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:18 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Volume fd637d2a-bd46-48ab-ae07-4057365edfc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd637d2a-bd46-48ab-ae07-4057365edfc1', 'volume_size': 1} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1161072447',display_name='tempest-VolumesGetTest-Volume-1171132458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd637d2a-bd46-48ab-ae07-4057365edfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:18Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Creating volume fd637d2a-bd46-48ab-ae07-4057365edfc1 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:18 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:29:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:18 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1 1073741824 Jul 06 12:29:18 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:19 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1 1073741824" returned: 0 in 0.997s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:19 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1 Jul 06 12:29:19 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:20 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1" returned: 0 in 0.767s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a728b14-4b76-4f8f-a260-8019dc0d86f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd637d2a-bd46-48ab-ae07-4057365edfc1', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7559e54c-5605-467d-b47c-ddfc51dac5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:20 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Volume volume-fd637d2a-bd46-48ab-ae07-4057365edfc1 (fd637d2a-bd46-48ab-ae07-4057365edfc1): created successfully Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7559e54c-5605-467d-b47c-ddfc51dac5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (632dfc10-4d13-4bc8-a190-fdc51fef8e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Flow 'volume_create_manager' (32f6defc-f97b-4413-af27-f6c88896b865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d83609-1d41-4ed2-8530-8302f337fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:20 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-563d53bc-c7fb-4d01-8d71-03c3a2d9daab tempest-VolumesGetTest-900190652 None] Created volume successfully. Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d83609-1d41-4ed2-8530-8302f337fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b83401d-d719-4c68-aab0-532b2506e74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ade8a7b2c4cae9dfb8c10de1f5396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:20Z,use_quota=True,user_id='914a2c2b068445c69123979245b94fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e791253e-eca9-4fca-bf70-80a171d3840a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e791253e-eca9-4fca-bf70-80a171d3840a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001793a8-1fdd-472d-b3a0-4a20dd4df4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001793a8-1fdd-472d-b3a0-4a20dd4df4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b83401d-d719-4c68-aab0-532b2506e74b', 'volume_name': 'volume-7b83401d-d719-4c68-aab0-532b2506e74b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37eda68-a443-4ebe-9914-4a201b73d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37eda68-a443-4ebe-9914-4a201b73d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0a1a76-bbef-4723-9c9f-1dd1125ffd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:20 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Volume 7b83401d-d719-4c68-aab0-532b2506e74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b83401d-d719-4c68-aab0-532b2506e74b', 'volume_size': 1} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b83401d-d719-4c68-aab0-532b2506e74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ade8a7b2c4cae9dfb8c10de1f5396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:20Z,use_quota=True,user_id='914a2c2b068445c69123979245b94fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Creating volume 7b83401d-d719-4c68-aab0-532b2506e74b {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:20 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:29:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:20 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b 1073741824 Jul 06 12:29:20 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:21 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b 1073741824" returned: 0 in 0.883s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:21 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b Jul 06 12:29:21 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-fd637d2a-bd46-48ab-ae07-4057365edfc1-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Lock "cinder-fd637d2a-bd46-48ab-ae07-4057365edfc1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-quobyte-fd637d2a-bd46-48ab-ae07-4057365edfc1" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-fd637d2a-bd46-48ab-ae07-4057365edfc1" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:21 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac3b2f2-e29a-4780-8eea-63c07529b5de]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:21 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1 Jul 06 12:29:21 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:22 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b" returned: 0 in 0.723s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:22 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0a1a76-bbef-4723-9c9f-1dd1125ffd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b83401d-d719-4c68-aab0-532b2506e74b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c107bd-f3e4-42f6-8d61-b25fa7cf8df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Volume volume-7b83401d-d719-4c68-aab0-532b2506e74b (7b83401d-d719-4c68-aab0-532b2506e74b): created successfully Jul 06 12:29:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c107bd-f3e4-42f6-8d61-b25fa7cf8df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Flow 'volume_create_manager' (32f6defc-f97b-4413-af27-f6c88896b865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cdcf340b-2eeb-4dc3-8298-3d8a06b6d3e5 tempest-CinderUnicodeTest-200229800 None] Created volume successfully. Jul 06 12:29:22 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1" returned: 0 in 0.878s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:22 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1 Jul 06 12:29:22 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Flow 'volume_create_manager' (40fa0831-5987-48d1-bbc4-59bfccf62af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a76cd0-beaf-4b56-be00-9d3564e7f129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a76cd0-beaf-4b56-be00-9d3564e7f129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1051043102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477a9e17-8e22-40b5-9889-792e9481e54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ade8a7b2c4cae9dfb8c10de1f5396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:23Z,use_quota=True,user_id='914a2c2b068445c69123979245b94fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d0dfed-dd17-41f8-b3f7-cfa460a18efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d0dfed-dd17-41f8-b3f7-cfa460a18efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138a415a-8cf6-40f6-b0a5-03029a2f6723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138a415a-8cf6-40f6-b0a5-03029a2f6723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477a9e17-8e22-40b5-9889-792e9481e54c', 'volume_name': 'volume-477a9e17-8e22-40b5-9889-792e9481e54c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f171b2b9-2c40-4c40-92cd-f6e9e61a10f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f171b2b9-2c40-4c40-92cd-f6e9e61a10f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2ac7db-6c1c-4478-97e9-ddeb17533407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Volume 477a9e17-8e22-40b5-9889-792e9481e54c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477a9e17-8e22-40b5-9889-792e9481e54c', 'volume_size': 1} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1051043102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477a9e17-8e22-40b5-9889-792e9481e54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ade8a7b2c4cae9dfb8c10de1f5396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:23Z,use_quota=True,user_id='914a2c2b068445c69123979245b94fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Creating volume 477a9e17-8e22-40b5-9889-792e9481e54c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:23 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:23 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c 1073741824 Jul 06 12:29:23 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:23 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fd637d2a-bd46-48ab-ae07-4057365edfc1" returned: 0 in 0.779s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-fd637d2a-bd46-48ab-ae07-4057365edfc1" released by "delete_volume" :: held 1.713s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Created reservations ['878fd14a-2f2c-4b1f-ad1c-d8f95febc7c3', '5a0ca7a5-fc99-4e0d-8cf3-ef09ad82e4b4', '607ad8d7-4cbe-4060-88d3-5c99201c6a63', '8d95ae27-6c30-4a9c-886f-fbfba4d6ea03'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:23 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:29:23 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-32efbb2c-5e83-4775-8734-722bcbe09287-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Lock "cinder-32efbb2c-5e83-4775-8734-722bcbe09287-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-quobyte-32efbb2c-5e83-4775-8734-722bcbe09287" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-32efbb2c-5e83-4775-8734-722bcbe09287" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb1339b-781f-45d2-8a67-fefc3d08dfae]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:24 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c 1073741824" returned: 0 in 1.167s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:24 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.751s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:24 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287 Jul 06 12:29:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Deleted volume successfully. Jul 06 12:29:24 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1be209c8-b664-4cf5-8b5b-4a44bcc746e3 tempest-VolumesGetTest-900190652 None] Lock "cinder-fd637d2a-bd46-48ab-ae07-4057365edfc1-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:24 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c Jul 06 12:29:24 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:25 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c" returned: 0 in 0.710s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2ac7db-6c1c-4478-97e9-ddeb17533407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477a9e17-8e22-40b5-9889-792e9481e54c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554fed85-4799-4d1d-9f24-3e3a5fccf622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Volume volume-477a9e17-8e22-40b5-9889-792e9481e54c (477a9e17-8e22-40b5-9889-792e9481e54c): created successfully Jul 06 12:29:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554fed85-4799-4d1d-9f24-3e3a5fccf622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Flow 'volume_create_manager' (40fa0831-5987-48d1-bbc4-59bfccf62af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2b7e79e0-b625-4b19-95ea-02f17a6dc257 tempest-CinderUnicodeTest-200229800 None] Created volume successfully. Jul 06 12:29:25 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287" returned: 0 in 1.070s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:25 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287 Jul 06 12:29:25 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:25 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32efbb2c-5e83-4775-8734-722bcbe09287" returned: 0 in 0.731s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-32efbb2c-5e83-4775-8734-722bcbe09287" released by "delete_volume" :: held 1.868s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Created reservations ['0716fa61-ea7d-437d-9e48-35460ec2a3bb', '9fd86b8e-c6d9-406f-a48a-8ec2dd20916b', '34e29a28-7f6f-4069-a9ee-11f2d4317c39', '3bc8b9fa-7461-4086-b7b1-a28dcd038ded'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:26 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:29:26 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] Creating offline snapshot cc73f9cd-6320-4525-824a-53a3916e3aab of volume 477a9e17-8e22-40b5-9889-792e9481e54c {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b550e1a3-6d42-4fdc-88cc-50c7b1f6e64e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:26 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c Jul 06 12:29:26 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:26 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.786s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Deleted volume successfully. Jul 06 12:29:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-44cc3248-de9a-4f81-9ea6-539056a98674 tempest-VolumesGetTest-900190652 None] Lock "cinder-32efbb2c-5e83-4775-8734-722bcbe09287-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (d20a1e85-792e-4c8d-b208-2ae8e5215be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6342a4-9648-433f-bf43-feb48500206f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6342a4-9648-433f-bf43-feb48500206f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-396362050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a431e6-009d-4942-aaed-bcd44bc32ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:27Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7423936-6d2e-4996-8865-2431fc0fedb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7423936-6d2e-4996-8865-2431fc0fedb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4684689-f0d0-4915-b20d-ee7ee1fbaaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4684689-f0d0-4915-b20d-ee7ee1fbaaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a431e6-009d-4942-aaed-bcd44bc32ea2', 'volume_name': 'volume-92a431e6-009d-4942-aaed-bcd44bc32ea2', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7127fa46-a557-40e0-aaf8-d04e5de1f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7127fa46-a557-40e0-aaf8-d04e5de1f650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db962bb6-2ecb-4079-8c83-e8a61a05ad40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Volume 92a431e6-009d-4942-aaed-bcd44bc32ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a431e6-009d-4942-aaed-bcd44bc32ea2', 'volume_size': 1} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:27 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c" returned: 0 in 0.922s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:27 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab 1G Jul 06 12:29:27 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:28 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab 1G" returned: 0 in 0.836s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477a9e17-8e22-40b5-9889-792e9481e54c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:28 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477a9e17-8e22-40b5-9889-792e9481e54c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab Jul 06 12:29:28 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:29 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477a9e17-8e22-40b5-9889-792e9481e54c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab" returned: 0 in 0.717s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:29 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab is being set with open permissions: ugo+rw Jul 06 12:29:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:29 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab Jul 06 12:29:29 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:29 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab" returned: 0 in 0.698s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:29 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.info Jul 06 12:29:29 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:30 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.info" returned: 0 in 0.710s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:30 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.info is being set with open permissions: ugo+rw Jul 06 12:29:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:30 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.info Jul 06 12:29:30 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:31 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.info" returned: 0 in 0.673s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.664s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.103s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-396362050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a431e6-009d-4942-aaed-bcd44bc32ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:27Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Creating volume 92a431e6-009d-4942-aaed-bcd44bc32ea2 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:31 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:31 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 1073741824 Jul 06 12:29:31 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7baa270e-f522-4efa-ae2d-c7e44c6e2b48 tempest-CinderUnicodeTest-200229800 None] Create snapshot completed successfully Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Acquiring lock "cinder-cc73f9cd-6320-4525-824a-53a3916e3aab-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Lock "cinder-cc73f9cd-6320-4525-824a-53a3916e3aab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Acquiring lock "cinder-quobyte-477a9e17-8e22-40b5-9889-792e9481e54c" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Lock "cinder-quobyte-477a9e17-8e22-40b5-9889-792e9481e54c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Acquiring lock "cinder-quobyte-cc73f9cd-6320-4525-824a-53a3916e3aab" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Lock "cinder-quobyte-cc73f9cd-6320-4525-824a-53a3916e3aab" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Deleting offline snapshot cc73f9cd-6320-4525-824a-53a3916e3aab of volume 477a9e17-8e22-40b5-9889-792e9481e54c {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] snapshot_file for this snap is: volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dfc6e9-2134-443d-a7f4-d4f0001d313f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:32 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab Jul 06 12:29:32 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:32 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 1073741824" returned: 0 in 0.943s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:32 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 Jul 06 12:29:32 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:32 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab" returned: 0 in 0.866s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-477a9e17-8e22-40b5-9889-792e9481e54c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ac0f22-835a-4ff4-a221-6ddfbeff84ea]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:32 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:29:32 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:32 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c Jul 06 12:29:32 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:33 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2" returned: 0 in 0.812s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db962bb6-2ecb-4079-8c83-e8a61a05ad40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a431e6-009d-4942-aaed-bcd44bc32ea2', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeeef220-eb58-414a-b3c0-a3bcd1f99f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:33 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Volume volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 (92a431e6-009d-4942-aaed-bcd44bc32ea2): created successfully Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeeef220-eb58-414a-b3c0-a3bcd1f99f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (d20a1e85-792e-4c8d-b208-2ae8e5215be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ca477254-05f6-482f-824e-1a6bd2508c1b tempest-VolumesGetTest-900190652 None] Created volume successfully. Jul 06 12:29:33 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.689s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:29:33 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c" returned: 0 in 0.843s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:33 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab Jul 06 12:29:33 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (ce9a6509-2928-4c46-8b99-ba1cb37c0d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82799f2-57c8-4425-885b-cca94c426cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82799f2-57c8-4425-885b-cca94c426cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2124140536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8129b464-54d6-4d50-ab32-230b5987b151,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=92a431e6-009d-4942-aaed-bcd44bc32ea2,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:34Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab355ad-0333-4941-ac75-e1328157b50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab355ad-0333-4941-ac75-e1328157b50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8cf4547-7268-4162-9792-3499deb73a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8cf4547-7268-4162-9792-3499deb73a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8129b464-54d6-4d50-ab32-230b5987b151', 'volume_name': 'volume-8129b464-54d6-4d50-ab32-230b5987b151', 'volume_size': 1, 'source_volid': '92a431e6-009d-4942-aaed-bcd44bc32ea2', 'source_volstatus': 'available'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7452db16-ace8-454e-810d-5ed5d79b80ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7452db16-ace8-454e-810d-5ed5d79b80ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cc36f3-df64-4cc3-b7ff-736bb103d105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Volume 8129b464-54d6-4d50-ab32-230b5987b151: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8129b464-54d6-4d50-ab32-230b5987b151', 'volume_size': 1, 'source_volid': '92a431e6-009d-4942-aaed-bcd44bc32ea2', 'source_volstatus': 'available'} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:34 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Cloning volume 92a431e6-009d-4942-aaed-bcd44bc32ea2 to volume 8129b464-54d6-4d50-ab32-230b5987b151 Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Creating offline snapshot 3bab32af-ad88-41d2-8052-1bed87c56409 of volume 92a431e6-009d-4942-aaed-bcd44bc32ea2 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec01a71c-9382-4e6a-ad72-1af8412dd2f4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:34 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 Jul 06 12:29:34 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:34 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab" returned: 0 in 0.870s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:34 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab Jul 06 12:29:34 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:35 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2" returned: 0 in 0.861s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:35 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 1G Jul 06 12:29:35 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:35 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c.cc73f9cd-6320-4525-824a-53a3916e3aab" returned: 0 in 0.752s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Lock "cinder-quobyte-cc73f9cd-6320-4525-824a-53a3916e3aab" released by "_delete_snapshot" :: held 3.458s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Lock "cinder-quobyte-477a9e17-8e22-40b5-9889-792e9481e54c" released by "delete_snapshot" :: held 3.482s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:35 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Created reservations ['198fda77-a919-4298-9a28-ba6045a7f0ec', 'bd8d59cd-5249-4c10-8f1f-0883e0876957', 'e0fb5bc3-cf51-4658-9e20-65b5fb22e680', '14123146-d6b9-4a91-87ce-b3ed7c8cb131'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Delete snapshot completed successfully. Jul 06 12:29:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-269b8bfb-4f99-45f2-91e4-b1fba4972d3b tempest-CinderUnicodeTest-200229800 None] Lock "cinder-cc73f9cd-6320-4525-824a-53a3916e3aab-delete_snapshot" released by "delete_snapshot" :: held 3.640s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Acquiring lock "cinder-477a9e17-8e22-40b5-9889-792e9481e54c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Lock "cinder-477a9e17-8e22-40b5-9889-792e9481e54c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Acquiring lock "cinder-quobyte-477a9e17-8e22-40b5-9889-792e9481e54c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Lock "cinder-quobyte-477a9e17-8e22-40b5-9889-792e9481e54c" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:36 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 1G" returned: 0 in 0.997s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e646555-c88e-498d-8aab-d5ef1b8e30b6]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:36 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 Jul 06 12:29:36 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:36 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c Jul 06 12:29:36 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:37 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409" returned: 0 in 0.787s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:37 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 is being set with open permissions: ugo+rw Jul 06 12:29:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:37 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 Jul 06 12:29:37 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:37 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c" returned: 0 in 1.002s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:37 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c Jul 06 12:29:37 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:37 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409" returned: 0 in 0.691s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:37 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.info Jul 06 12:29:37 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:38 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-477a9e17-8e22-40b5-9889-792e9481e54c" returned: 0 in 0.753s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Lock "cinder-quobyte-477a9e17-8e22-40b5-9889-792e9481e54c" released by "delete_volume" :: held 1.840s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Created reservations ['206cf67a-b64a-43de-b40d-222af419bec9', '06254886-3966-485d-b206-fb7566a680ab', 'fac8119f-14da-4d58-a1dc-94607c900ba3', 'a64b5db0-28c7-4b3c-8708-b6e561b406a9'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:38 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:29:38 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Acquiring lock "cinder-7b83401d-d719-4c68-aab0-532b2506e74b-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Lock "cinder-7b83401d-d719-4c68-aab0-532b2506e74b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:38 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.info" returned: 0 in 0.784s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:38 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.info is being set with open permissions: ugo+rw Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Acquiring lock "cinder-quobyte-7b83401d-d719-4c68-aab0-532b2506e74b" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:38 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.info Jul 06 12:29:38 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Lock "cinder-quobyte-7b83401d-d719-4c68-aab0-532b2506e74b" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[986c55b7-c21f-497c-8734-4dddcf6db4c5]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:38 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b Jul 06 12:29:38 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:39 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.847s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Deleted volume successfully. Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c05d62c8-5c22-442d-8f69-aa95364ef87d tempest-CinderUnicodeTest-200229800 None] Lock "cinder-477a9e17-8e22-40b5-9889-792e9481e54c-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:39 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.info" returned: 0 in 0.728s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-quobyte-8129b464-54d6-4d50-ab32-230b5987b151" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-8129b464-54d6-4d50-ab32-230b5987b151" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] snapshot: 3bab32af-ad88-41d2-8052-1bed87c56409, volume: 8129b464-54d6-4d50-ab32-230b5987b151, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2259cc1-546d-4267-92ba-bdf0dece1468]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:39 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 Jul 06 12:29:39 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:39 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b" returned: 0 in 0.935s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:39 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b Jul 06 12:29:39 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:40 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409" returned: 0 in 0.828s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a431e6-009d-4942-aaed-bcd44bc32ea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9d0bad-047d-48fe-9bc3-dd115c71dfe4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:40 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 Jul 06 12:29:40 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:40 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7b83401d-d719-4c68-aab0-532b2506e74b" returned: 0 in 0.967s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Lock "cinder-quobyte-7b83401d-d719-4c68-aab0-532b2506e74b" released by "delete_volume" :: held 1.973s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Created reservations ['0190b7ca-ed51-4b6a-a49d-636a9c5e7004', '7479aee5-f72a-413e-a5bf-aed496896f82', 'fe6c595b-15fe-4f0c-9476-bc3799cc96df', 'dee19e63-8345-49b8-b4b4-30e5edaa92dd'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:40 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:29:40 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:41 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2" returned: 0 in 0.884s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:41 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:29:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:41 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151 Jul 06 12:29:41 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:41 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.827s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:41 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:29:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Deleted volume successfully. Jul 06 12:29:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c784b45c-ed39-42c3-9a58-9996254b3b49 tempest-CinderUnicodeTest-200229800 None] Lock "cinder-7b83401d-d719-4c68-aab0-532b2506e74b-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:47 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151" returned: 0 in 5.978s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0828f57d-b1c9-4fa7-9fff-d59d4e45760c]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:47 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 Jul 06 12:29:47 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:48 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2" returned: 0 in 1.272s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:48 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:29:48 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Converted 1024.00 MB image at 171.28 MB/s Jul 06 12:29:48 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151 is being set with open permissions: ugo+rw Jul 06 12:29:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:48 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151 Jul 06 12:29:48 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:49 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151" returned: 0 in 0.720s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-8129b464-54d6-4d50-ab32-230b5987b151" released by "_copy_volume_from_snapshot" :: held 9.783s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-quobyte-3bab32af-ad88-41d2-8052-1bed87c56409" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-3bab32af-ad88-41d2-8052-1bed87c56409" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Deleting offline snapshot 3bab32af-ad88-41d2-8052-1bed87c56409 of volume 92a431e6-009d-4942-aaed-bcd44bc32ea2 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:29:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] snapshot_file for this snap is: volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:29:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2981c8-bb94-42cb-bc29-09bc4b8e8991]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:49 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 Jul 06 12:29:49 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:50 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409" returned: 0 in 0.858s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a431e6-009d-4942-aaed-bcd44bc32ea2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:29:50 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[095c22c7-8b0a-4532-8b8b-876358c95311]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:50 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 Jul 06 12:29:50 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:51 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2" returned: 0 in 0.953s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:51 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 Jul 06 12:29:51 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:51 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=78,cinder:SELECT=69,cinder:INSERT=22,cinder:DELETE=9 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:29:51 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409" returned: 0 in 0.959s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:52 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409 Jul 06 12:29:52 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:52 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2.3bab32af-ad88-41d2-8052-1bed87c56409" returned: 0 in 0.864s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-3bab32af-ad88-41d2-8052-1bed87c56409" released by "_delete_snapshot" :: held 3.777s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:52 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=57,cinder:INSERT=25,cinder:UPDATE=82,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.695s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cc36f3-df64-4cc3-b7ff-736bb103d105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8129b464-54d6-4d50-ab32-230b5987b151', 'volume_size': 1, 'source_volid': '92a431e6-009d-4942-aaed-bcd44bc32ea2', 'source_volstatus': 'available'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1808d8-0fbb-406e-93ad-9b37b6aa0f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Volume volume-8129b464-54d6-4d50-ab32-230b5987b151 (8129b464-54d6-4d50-ab32-230b5987b151): created successfully Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1808d8-0fbb-406e-93ad-9b37b6aa0f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (ce9a6509-2928-4c46-8b99-ba1cb37c0d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2a3f2d61-1dcf-4ece-b86b-4dc82d043f9c tempest-VolumesGetTest-900190652 None] Created volume successfully. Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Flow 'volume_create_manager' (1fd257c1-aa9f-40e8-a340-68d28d32ce29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b01846-ee25-49e5-af05-b4aa9263cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b01846-ee25-49e5-af05-b4aa9263cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933672760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746854f2-f80d-4f49-b8d5-aac1630c8a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc3acf534b74ed1903b503c33f2dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:53Z,use_quota=True,user_id='38501f03fe054825a11a7470dd469de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78770dd-e2c2-4b2a-bff1-dac79ac8c81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78770dd-e2c2-4b2a-bff1-dac79ac8c81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b624b343-3613-4864-9422-fedb6b96c114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b624b343-3613-4864-9422-fedb6b96c114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746854f2-f80d-4f49-b8d5-aac1630c8a88', 'volume_name': 'volume-746854f2-f80d-4f49-b8d5-aac1630c8a88', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399e920a-ec63-4e53-ad57-b171700da6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399e920a-ec63-4e53-ad57-b171700da6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563ea1b5-fc01-4d67-9d93-2b3a1497c4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Volume 746854f2-f80d-4f49-b8d5-aac1630c8a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746854f2-f80d-4f49-b8d5-aac1630c8a88', 'volume_size': 1} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933672760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746854f2-f80d-4f49-b8d5-aac1630c8a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc3acf534b74ed1903b503c33f2dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:53Z,use_quota=True,user_id='38501f03fe054825a11a7470dd469de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Creating volume 746854f2-f80d-4f49-b8d5-aac1630c8a88 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:53 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:29:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:53 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88 1073741824 Jul 06 12:29:53 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:54 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88 1073741824" returned: 0 in 0.900s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:54 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88 Jul 06 12:29:54 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (66aba2ad-75a8-4a68-a593-90e39863013e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352f6fd3-7734-4e9d-ad77-46f78ae2f25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352f6fd3-7734-4e9d-ad77-46f78ae2f25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1208049720',display_name='tempest-VolumesGetTest-Volume-1054603088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:55Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bdd38f-19ad-4e0d-bdbe-c707cdd9f9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bdd38f-19ad-4e0d-bdbe-c707cdd9f9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2867b1b1-74bc-4153-8761-dab2c4f0920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2867b1b1-74bc-4153-8761-dab2c4f0920c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394', 'volume_name': 'volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fa89e5-ea80-446c-830b-096af331e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fa89e5-ea80-446c-830b-096af331e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a89523-d323-4bef-bdc8-0a20efc3af74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Volume c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394', 'volume_size': 1} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:55 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88" returned: 0 in 0.882s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.189s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1208049720',display_name='tempest-VolumesGetTest-Volume-1054603088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:29:55Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Creating volume c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:29:55 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563ea1b5-fc01-4d67-9d93-2b3a1497c4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746854f2-f80d-4f49-b8d5-aac1630c8a88', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394 1073741824 Jul 06 12:29:55 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ac76aa-118b-4346-a8d8-1d027eb584bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Volume volume-746854f2-f80d-4f49-b8d5-aac1630c8a88 (746854f2-f80d-4f49-b8d5-aac1630c8a88): created successfully Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ac76aa-118b-4346-a8d8-1d027eb584bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Flow 'volume_create_manager' (1fd257c1-aa9f-40e8-a340-68d28d32ce29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0d26b6c6-716e-4b30-bdba-9db5f821e016 tempest-ProjectReaderTests-364139428 None] Created volume successfully. Jul 06 12:29:56 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394 1073741824" returned: 0 in 0.985s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:56 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394 Jul 06 12:29:56 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Acquiring lock "cinder-746854f2-f80d-4f49-b8d5-aac1630c8a88-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Lock "cinder-746854f2-f80d-4f49-b8d5-aac1630c8a88-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Acquiring lock "cinder-quobyte-746854f2-f80d-4f49-b8d5-aac1630c8a88" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Lock "cinder-quobyte-746854f2-f80d-4f49-b8d5-aac1630c8a88" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2600e1a-fcf3-4659-a5af-9af4a61689b7]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:57 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394" returned: 0 in 0.841s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:29:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:57 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88 Jul 06 12:29:57 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a89523-d323-4bef-bdc8-0a20efc3af74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c9f518-d397-43f5-9dce-36af5134a401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Volume volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394 (c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394): created successfully Jul 06 12:29:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c9f518-d397-43f5-9dce-36af5134a401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (66aba2ad-75a8-4a68-a593-90e39863013e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-be5afcf7-9c8b-4d4b-8c4c-04eb2edb68b3 tempest-VolumesGetTest-900190652 None] Created volume successfully. Jul 06 12:29:58 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88" returned: 0 in 0.987s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:58 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88 Jul 06 12:29:58 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Lock "cinder-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-quobyte-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:29:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:29:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[715602a3-56f9-47b4-9f6b-f72ef37ba284]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:29:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:58 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394 Jul 06 12:29:58 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:58 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-746854f2-f80d-4f49-b8d5-aac1630c8a88" returned: 0 in 0.917s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Lock "cinder-quobyte-746854f2-f80d-4f49-b8d5-aac1630c8a88" released by "delete_volume" :: held 1.975s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Created reservations ['ba247c38-f6d7-47a3-b86d-56f384015943', '0a7e939b-5d30-4ed9-97cd-9983fc360b1a', 'fa4f4056-bf14-4dea-8074-00d7f0853a1f', '9b5a3836-9e59-45ad-b75e-68611aaf0662'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:59 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:29:59 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:59 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394" returned: 0 in 1.202s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:29:59 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394 Jul 06 12:29:59 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Flow 'volume_create_manager' (4bc5370b-0368-4aba-b892-9734fa755e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11572a4f-5b63-4cb5-b8f9-0061d472325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11572a4f-5b63-4cb5-b8f9-0061d472325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078232724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1045bf2b-a851-45af-ae26-d4179359ee21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc3acf534b74ed1903b503c33f2dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:00Z,use_quota=True,user_id='38501f03fe054825a11a7470dd469de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a84f08-7bfc-45a7-98eb-e239e601d73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a84f08-7bfc-45a7-98eb-e239e601d73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:29:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad96b15-48f3-4d27-8b6e-21d408dad984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad96b15-48f3-4d27-8b6e-21d408dad984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1045bf2b-a851-45af-ae26-d4179359ee21', 'volume_name': 'volume-1045bf2b-a851-45af-ae26-d4179359ee21', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ced8f3-6f37-4694-b04b-2d03072ee73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ced8f3-6f37-4694-b04b-2d03072ee73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206fb253-ef4a-4a84-81b4-403dff533a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:00 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Volume 1045bf2b-a851-45af-ae26-d4179359ee21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1045bf2b-a851-45af-ae26-d4179359ee21', 'volume_size': 1} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078232724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1045bf2b-a851-45af-ae26-d4179359ee21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc3acf534b74ed1903b503c33f2dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:00Z,use_quota=True,user_id='38501f03fe054825a11a7470dd469de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Creating volume 1045bf2b-a851-45af-ae26-d4179359ee21 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:30:00 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:00 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21 1073741824 Jul 06 12:30:00 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:00 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.014s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Deleted volume successfully. Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8dc835d-dabb-4ba2-b1af-29901725303f tempest-ProjectReaderTests-364139428 None] Lock "cinder-746854f2-f80d-4f49-b8d5-aac1630c8a88-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:00 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394" returned: 0 in 0.866s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394" released by "delete_volume" :: held 2.128s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Created reservations ['b0b06390-cce9-4a14-b2e8-d6a69f796157', '575c157f-a87f-4cca-9fc8-331143ef70e3', '02adfc71-5d3e-4ee9-b1ae-b3e823ea9feb', 'fa8231f4-466b-49dd-8c1f-6bb278d610ec'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:00 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:30:00 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:01 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21 1073741824" returned: 0 in 1.007s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:01 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21 Jul 06 12:30:01 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:01 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.766s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Deleted volume successfully. Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce6f2fb7-4fa1-4e18-941c-3af2834f3e91 tempest-VolumesGetTest-900190652 None] Lock "cinder-c92c62d0-79a1-4dd0-b8a5-d0f6c1c1b394-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:01 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21" returned: 0 in 0.825s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-8129b464-54d6-4d50-ab32-230b5987b151-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206fb253-ef4a-4a84-81b4-403dff533a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1045bf2b-a851-45af-ae26-d4179359ee21', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5f78f6-b04b-40e3-84b0-0cd53d67a339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Lock "cinder-8129b464-54d6-4d50-ab32-230b5987b151-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Volume volume-1045bf2b-a851-45af-ae26-d4179359ee21 (1045bf2b-a851-45af-ae26-d4179359ee21): created successfully Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5f78f6-b04b-40e3-84b0-0cd53d67a339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Flow 'volume_create_manager' (4bc5370b-0368-4aba-b892-9734fa755e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6c0ca646-0944-4d56-9ccb-28acd6fd3220 tempest-ProjectReaderTests-364139428 None] Created volume successfully. Jul 06 12:30:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-quobyte-8129b464-54d6-4d50-ab32-230b5987b151" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:02 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-8129b464-54d6-4d50-ab32-230b5987b151" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fecb3d5-fc82-42f9-873e-a06d39990786]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:02 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151 Jul 06 12:30:02 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:02 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151" returned: 0 in 0.807s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:02 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151 Jul 06 12:30:02 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Acquiring lock "cinder-1045bf2b-a851-45af-ae26-d4179359ee21-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Lock "cinder-1045bf2b-a851-45af-ae26-d4179359ee21-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Acquiring lock "cinder-quobyte-1045bf2b-a851-45af-ae26-d4179359ee21" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Lock "cinder-quobyte-1045bf2b-a851-45af-ae26-d4179359ee21" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06f3ff4-eb78-43fa-8a3b-80ec1f8b5609]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:03 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21 Jul 06 12:30:03 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:03 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8129b464-54d6-4d50-ab32-230b5987b151" returned: 0 in 0.743s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-8129b464-54d6-4d50-ab32-230b5987b151" released by "delete_volume" :: held 1.602s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Created reservations ['100e9a06-8728-4466-a1aa-160b4e3703a4', '4fd4164e-b645-43c9-93fb-0215c782c909', '95feb9e3-b024-4abb-a03d-32d2c798b2bc', 'f48b3555-3686-43ca-a3fc-e893729f3e37'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:03 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:30:03 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:04 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21" returned: 0 in 0.856s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:04 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21 Jul 06 12:30:04 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-92a431e6-009d-4942-aaed-bcd44bc32ea2-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Lock "cinder-92a431e6-009d-4942-aaed-bcd44bc32ea2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-quobyte-92a431e6-009d-4942-aaed-bcd44bc32ea2" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-92a431e6-009d-4942-aaed-bcd44bc32ea2" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e114547d-cc92-47d6-a8eb-7b227c8c41b0]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:04 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 Jul 06 12:30:04 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:04 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.051s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:04 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Deleted volume successfully. Jul 06 12:30:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-35ccea67-d14a-4dbf-be4d-46d0e0d21b9e tempest-VolumesGetTest-900190652 None] Lock "cinder-8129b464-54d6-4d50-ab32-230b5987b151-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:05 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1045bf2b-a851-45af-ae26-d4179359ee21" returned: 0 in 0.937s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Lock "cinder-quobyte-1045bf2b-a851-45af-ae26-d4179359ee21" released by "delete_volume" :: held 1.846s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:05 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Created reservations ['0b5a759e-868b-46a7-8a9e-b9a891f72e19', '40d9d383-ee5f-44ca-b581-69aacf61da21', 'b57df1b3-0504-437d-90af-16720d47b1ca', 'd87452aa-e4e4-4e79-9d3b-18b83fa63b95'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:05 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:30:05 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:05 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2" returned: 0 in 0.875s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:05 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2 Jul 06 12:30:05 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Flow 'volume_create_manager' (12351021-f688-4c84-92ed-dce8b0a95a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c54b98e-9591-4dea-a316-7ba770e43ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:06 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c54b98e-9591-4dea-a316-7ba770e43ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-287029715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3ef7d9-3046-47c7-ad72-ad024c83384d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc3acf534b74ed1903b503c33f2dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:06Z,use_quota=True,user_id='38501f03fe054825a11a7470dd469de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d6bd85-910e-469f-8aa2-73237865d7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d6bd85-910e-469f-8aa2-73237865d7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d49242-b791-44d9-b0eb-5758a4a94589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d49242-b791-44d9-b0eb-5758a4a94589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3ef7d9-3046-47c7-ad72-ad024c83384d', 'volume_name': 'volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fa1935-6e56-4f57-85c3-dc3e498e68f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fa1935-6e56-4f57-85c3-dc3e498e68f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15926fe-3397-4369-9b4d-93be9ff53bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Volume 4c3ef7d9-3046-47c7-ad72-ad024c83384d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d', 'volume_size': 1} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-287029715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3ef7d9-3046-47c7-ad72-ad024c83384d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc3acf534b74ed1903b503c33f2dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:06Z,use_quota=True,user_id='38501f03fe054825a11a7470dd469de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Creating volume 4c3ef7d9-3046-47c7-ad72-ad024c83384d {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:30:06 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.893s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Deleted volume successfully. Jul 06 12:30:06 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d 1073741824 Jul 06 12:30:06 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b323274e-669a-4b82-ac8c-981acaf281f1 tempest-ProjectReaderTests-364139428 None] Lock "cinder-1045bf2b-a851-45af-ae26-d4179359ee21-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:06 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-92a431e6-009d-4942-aaed-bcd44bc32ea2" returned: 0 in 0.757s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-92a431e6-009d-4942-aaed-bcd44bc32ea2" released by "delete_volume" :: held 1.726s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Created reservations ['9adcb6a4-6cdd-44f6-b8d8-aaaa37fa171c', '52502e1f-31b5-4cee-b334-8d4e28b99efe', '0bceaac6-9279-4b69-87c5-cc6c65a7428c', 'd8f5bb64-763a-4238-91b9-a72d935f4595'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:06 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:30:06 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:07 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d 1073741824" returned: 0 in 1.146s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:07 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.854s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Deleted volume successfully. Jul 06 12:30:07 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d Jul 06 12:30:07 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0975e450-1f23-4275-acae-9bddbef070eb tempest-VolumesGetTest-900190652 None] Lock "cinder-92a431e6-009d-4942-aaed-bcd44bc32ea2-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (83043429-01b5-4857-9914-790c7e2a46f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0527380a-23bb-4e09-93dd-6120e54561a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0527380a-23bb-4e09-93dd-6120e54561a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-83021247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3505914-72bb-4020-ad87-7402a126c3e9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:08Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b303ad-72c4-4811-844d-8ca2f3aeeb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b303ad-72c4-4811-844d-8ca2f3aeeb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61866107-e59d-443b-bae2-1008b12414e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:07 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:30:08 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d" returned: 0 in 0.696s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15926fe-3397-4369-9b4d-93be9ff53bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40f53d7-3feb-4740-85c5-32e991b7d45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Volume volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d (4c3ef7d9-3046-47c7-ad72-ad024c83384d): created successfully Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40f53d7-3feb-4740-85c5-32e991b7d45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Flow 'volume_create_manager' (12351021-f688-4c84-92ed-dce8b0a95a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7634f55d-92a7-4b31-91b7-5e7daf7e789b tempest-ProjectReaderTests-364139428 None] Created volume successfully. Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61866107-e59d-443b-bae2-1008b12414e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3505914-72bb-4020-ad87-7402a126c3e9', 'volume_name': 'volume-e3505914-72bb-4020-ad87-7402a126c3e9', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c187b988-5139-41d2-a353-d9de305936f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c187b988-5139-41d2-a353-d9de305936f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed9bf1b-5ffe-4713-be71-3c83e4ff3bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Volume e3505914-72bb-4020-ad87-7402a126c3e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3505914-72bb-4020-ad87-7402a126c3e9', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Trying to clone e3505914-72bb-4020-ad87-7402a126c3e9 from image b5606d26-431d-46eb-8401-a0b1e0a3d067 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:30:08 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Image download 20.69 MB at 20.69 MB/s Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9ba011-a4f4-4dd6-a956-b7a27e525ba0]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:08 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD Jul 06 12:30:08 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Acquiring lock "cinder-4c3ef7d9-3046-47c7-ad72-ad024c83384d-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Lock "cinder-4c3ef7d9-3046-47c7-ad72-ad024c83384d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:09 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD" returned: 0 in 0.788s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:09 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Temporary image b5606d26-431d-46eb-8401-a0b1e0a3d067 is fetched for user 7a00971e22884a9fa7ccb7a4546f4924. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:30:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Acquiring lock "cinder-quobyte-4c3ef7d9-3046-47c7-ad72-ad024c83384d" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Lock "cinder-quobyte-4c3ef7d9-3046-47c7-ad72-ad024c83384d" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe9493c-b1b2-42cd-ad0b-87d7a5ff2be6]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0815c-335e-4351-8f02-d0a7d6a6d4ba]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:09 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d Jul 06 12:30:09 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:09 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD Jul 06 12:30:09 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:10 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d" returned: 0 in 0.829s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:10 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD" returned: 0 in 0.816s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-83021247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3505914-72bb-4020-ad87-7402a126c3e9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:08Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Creating volume e3505914-72bb-4020-ad87-7402a126c3e9 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:30:10 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:10 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:30:10 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:30:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:10 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 1073741824 Jul 06 12:30:10 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:10 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4c3ef7d9-3046-47c7-ad72-ad024c83384d" returned: 0 in 0.719s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Lock "cinder-quobyte-4c3ef7d9-3046-47c7-ad72-ad024c83384d" released by "delete_volume" :: held 1.600s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Created reservations ['22ce0518-bb9b-4269-b00f-5d22768a070c', '5714a57b-6619-499d-94bf-b1a054823da3', '798ff664-553d-4a87-b43c-63162a5f7041', '648c7364-6580-420c-b0c2-efd8d261b6fd'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:11 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:30:11 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:11 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 1073741824" returned: 0 in 0.943s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:11 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 Jul 06 12:30:11 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:11 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.692s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Deleted volume successfully. Jul 06 12:30:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52ad8918-0280-4520-b462-211ea5de4c3a tempest-ProjectReaderTests-364139428 None] Lock "cinder-4c3ef7d9-3046-47c7-ad72-ad024c83384d-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:12 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9" returned: 0 in 0.733s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Attempting download of b5606d26-431d-46eb-8401-a0b1e0a3d067 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}])) to volume e3505914-72bb-4020-ad87-7402a126c3e9. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7ef36c-90b0-4bad-a07d-1aab5fb8c949]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_11or2swf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Flow 'volume_create_manager' (260720dc-c011-47da-a0cf-d6e9390c81b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ba843d-2fd8-4a58-8236-ec5c87b27d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ba843d-2fd8-4a58-8236-ec5c87b27d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-572127387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a688021-1e1e-43b1-bf09-a619f6dc0aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc3acf534b74ed1903b503c33f2dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:12Z,use_quota=True,user_id='38501f03fe054825a11a7470dd469de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603828f6-6362-4ec2-aa22-d5d684ebcdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603828f6-6362-4ec2-aa22-d5d684ebcdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e165af60-0b80-4670-9e7d-66991f267977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e165af60-0b80-4670-9e7d-66991f267977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a688021-1e1e-43b1-bf09-a619f6dc0aa6', 'volume_name': 'volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efebaa00-4eca-4dbc-a736-a326417110ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efebaa00-4eca-4dbc-a736-a326417110ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:12 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_11or2swf Jul 06 12:30:12 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e38e5f-2bd3-44be-aca0-02a7d6570237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Volume 4a688021-1e1e-43b1-bf09-a619f6dc0aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6', 'volume_size': 1} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-572127387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a688021-1e1e-43b1-bf09-a619f6dc0aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bc3acf534b74ed1903b503c33f2dacb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:12Z,use_quota=True,user_id='38501f03fe054825a11a7470dd469de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Creating volume 4a688021-1e1e-43b1-bf09-a619f6dc0aa6 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:30:12 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:12 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6 1073741824 Jul 06 12:30:12 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:12 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_11or2swf" returned: 0 in 0.837s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_11or2swf {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:13 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_11or2swf Jul 06 12:30:13 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:13 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6 1073741824" returned: 0 in 0.969s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:13 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6 Jul 06 12:30:13 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:13 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_11or2swf" returned: 1 in 0.820s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_11or2swf' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:30:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e93ee36-ecd7-44ea-a9f6-de0393179ba9]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:13 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD Jul 06 12:30:13 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:13 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6" returned: 0 in 0.691s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:30:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e38e5f-2bd3-44be-aca0-02a7d6570237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ecda6d-1481-4ed1-888f-1497e011f145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:14 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Volume volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6 (4a688021-1e1e-43b1-bf09-a619f6dc0aa6): created successfully Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ecda6d-1481-4ed1-888f-1497e011f145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Flow 'volume_create_manager' (260720dc-c011-47da-a0cf-d6e9390c81b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:14 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-04d71185-4828-40c5-8508-73cc88443fd9 tempest-ProjectReaderTests-364139428 None] Created volume successfully. Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Acquiring lock "cinder-4a688021-1e1e-43b1-bf09-a619f6dc0aa6-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Lock "cinder-4a688021-1e1e-43b1-bf09-a619f6dc0aa6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Acquiring lock "cinder-quobyte-4a688021-1e1e-43b1-bf09-a619f6dc0aa6" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Lock "cinder-quobyte-4a688021-1e1e-43b1-bf09-a619f6dc0aa6" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e823e314-ff90-494f-8fae-52ab95dd18f1]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:14 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6 Jul 06 12:30:14 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:14 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD" returned: 0 in 0.835s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] b5606d26-431d-46eb-8401-a0b1e0a3d067 was qcow2, converting to raw {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:30:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:14 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 Jul 06 12:30:14 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:15 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6" returned: 0 in 0.869s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:15 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6 Jul 06 12:30:15 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:15 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-4a688021-1e1e-43b1-bf09-a619f6dc0aa6" returned: 0 in 0.717s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Lock "cinder-quobyte-4a688021-1e1e-43b1-bf09-a619f6dc0aa6" released by "delete_volume" :: held 1.643s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:16 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Created reservations ['55be16a4-2a7a-46c2-be30-282fbc9ce54b', '40bfe38d-35fe-4da4-8de3-8247fce24555', '70ce6d79-f80c-4803-923a-97bb1549f79b', 'be9df8b1-802c-4ac4-9a18-6cb16e5e3ca8'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:16 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:30:16 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:16 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9" returned: 0 in 2.216s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:16 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_k715vnr2devstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:30:16 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Converted 112.00 MB image at 50.52 MB/s Jul 06 12:30:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:16 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 1G Jul 06 12:30:16 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:17 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.865s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:17 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Deleted volume successfully. Jul 06 12:30:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-24e1a573-7b03-4e92-90ca-8358bef42305 tempest-ProjectReaderTests-364139428 None] Lock "cinder-4a688021-1e1e-43b1-bf09-a619f6dc0aa6-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:17 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 1G" returned: 0 in 0.846s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71b8e55-5e78-4127-9810-7b745633f491]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:17 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 Jul 06 12:30:17 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:18 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9" returned: 0 in 0.971s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:18 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 Jul 06 12:30:18 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:19 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9" returned: 1 in 0.780s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:30:19 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Downloaded image b5606d26-431d-46eb-8401-a0b1e0a3d067 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}])) to volume e3505914-72bb-4020-ad87-7402a126c3e9 successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:30:19 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Temporary image b5606d26-431d-46eb-8401-a0b1e0a3d067 for user 7a00971e22884a9fa7ccb7a4546f4924 is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:30:19 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Marking volume e3505914-72bb-4020-ad87-7402a126c3e9 as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:30:19 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Copying metadata from image b5606d26-431d-46eb-8401-a0b1e0a3d067 to e3505914-72bb-4020-ad87-7402a126c3e9. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:30:19 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Creating volume glance metadata for volume e3505914-72bb-4020-ad87-7402a126c3e9 backed by image b5606d26-431d-46eb-8401-a0b1e0a3d067 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:30:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed9bf1b-5ffe-4713-be71-3c83e4ff3bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3505914-72bb-4020-ad87-7402a126c3e9', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb0019c-9348-4761-9c7b-f3a319385e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:19 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Volume volume-e3505914-72bb-4020-ad87-7402a126c3e9 (e3505914-72bb-4020-ad87-7402a126c3e9): created successfully Jul 06 12:30:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb0019c-9348-4761-9c7b-f3a319385e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (83043429-01b5-4857-9914-790c7e2a46f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cbe403f2-70b0-49e9-b22b-518fd35bcad8 tempest-VolumesGetTest-900190652 None] Created volume successfully. Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (c3c48936-34b4-4ce8-8b4d-ed3bd88da867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff04d552-b62d-4be4-815f-b46f76fd8d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff04d552-b62d-4be4-815f-b46f76fd8d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-921728795',display_name='tempest-VolumesGetTest-Volume-628804350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a36247-6886-4022-82e6-7dd721fc5096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:21Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cac0c5-5ac0-474a-aa12-0d99e2eb9dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cac0c5-5ac0-474a-aa12-0d99e2eb9dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a4d9cc-41a0-4fec-8f48-3f5ac668d3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a4d9cc-41a0-4fec-8f48-3f5ac668d3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a36247-6886-4022-82e6-7dd721fc5096', 'volume_name': 'volume-55a36247-6886-4022-82e6-7dd721fc5096', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1634b74f-e5d3-49a4-90cc-10803fae5519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1634b74f-e5d3-49a4-90cc-10803fae5519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630177c3-ed37-49a5-916d-4df528cfaaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Volume 55a36247-6886-4022-82e6-7dd721fc5096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a36247-6886-4022-82e6-7dd721fc5096', 'volume_size': 1} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:30:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-921728795',display_name='tempest-VolumesGetTest-Volume-628804350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a36247-6886-4022-82e6-7dd721fc5096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f88c7be842f469fbcd7fc8dde87c479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:30:21Z,use_quota=True,user_id='7a00971e22884a9fa7ccb7a4546f4924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Creating volume 55a36247-6886-4022-82e6-7dd721fc5096 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:30:21 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:30:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:21 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096 1073741824 Jul 06 12:30:21 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:22 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096 1073741824" returned: 0 in 0.831s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:22 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096 Jul 06 12:30:22 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:23 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096" returned: 0 in 0.626s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630177c3-ed37-49a5-916d-4df528cfaaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a36247-6886-4022-82e6-7dd721fc5096', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1d6e37-4286-4a4c-b35c-5ceabf23c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:30:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Volume volume-55a36247-6886-4022-82e6-7dd721fc5096 (55a36247-6886-4022-82e6-7dd721fc5096): created successfully Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1d6e37-4286-4a4c-b35c-5ceabf23c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Flow 'volume_create_manager' (c3c48936-34b4-4ce8-8b4d-ed3bd88da867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:30:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-12962ff0-0926-4072-b810-da806d7aca3f tempest-VolumesGetTest-900190652 None] Created volume successfully. Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-55a36247-6886-4022-82e6-7dd721fc5096-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Lock "cinder-55a36247-6886-4022-82e6-7dd721fc5096-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-quobyte-55a36247-6886-4022-82e6-7dd721fc5096" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-55a36247-6886-4022-82e6-7dd721fc5096" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9463e2b2-9ae3-492b-9af9-5c580fceaea0]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:23 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096 Jul 06 12:30:23 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:24 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096" returned: 0 in 0.758s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:24 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096 Jul 06 12:30:24 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:25 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-55a36247-6886-4022-82e6-7dd721fc5096" returned: 0 in 0.660s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-55a36247-6886-4022-82e6-7dd721fc5096" released by "delete_volume" :: held 1.461s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Created reservations ['c53e703a-081f-4ef2-a1e1-6a33114734d4', '2d29c520-18ed-4661-b9d0-69179d96e86f', '5909f5da-1fe4-4727-b8a1-764a34852ceb', 'b1525e39-fba6-4a01-968c-d403ecdc9f84'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:25 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:30:25 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-e3505914-72bb-4020-ad87-7402a126c3e9-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Lock "cinder-e3505914-72bb-4020-ad87-7402a126c3e9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Acquiring lock "cinder-quobyte-e3505914-72bb-4020-ad87-7402a126c3e9" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:30:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-e3505914-72bb-4020-ad87-7402a126c3e9" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:30:26 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.738s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Deleted volume successfully. Jul 06 12:30:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab11927-2820-42c0-8d63-44ae0c81000a]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:30:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c64dc1a9-30dd-45b7-86ac-f574ba19c0fc tempest-VolumesGetTest-900190652 None] Lock "cinder-55a36247-6886-4022-82e6-7dd721fc5096-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:26 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 Jul 06 12:30:26 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:26 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9" returned: 0 in 0.724s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:26 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 Jul 06 12:30:26 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:27 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9" returned: 1 in 0.756s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:30:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:27 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9 Jul 06 12:30:27 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:28 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e3505914-72bb-4020-ad87-7402a126c3e9" returned: 0 in 0.645s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Lock "cinder-quobyte-e3505914-72bb-4020-ad87-7402a126c3e9" released by "delete_volume" :: held 2.191s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:28 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Created reservations ['0fb25188-db0f-402e-978b-92383bdd056e', 'b5c0fbc5-54d2-4551-80fc-1fdcbaa1f016', 'a239eec0-a9e0-4611-b792-96b2974cbc37', 'ac081ba8-fa8d-4a46-99cf-2471dc2141f1'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:30:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:28 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:30:28 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:29 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.617s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:29 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Deleted volume successfully. Jul 06 12:30:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3ba853db-3f13-44dc-9e89-6fdc9592069f tempest-VolumesGetTest-900190652 None] Lock "cinder-e3505914-72bb-4020-ad87-7402a126c3e9-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:30:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:30:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:30:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:30:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:30:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:30:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:30:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:30:32 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:30:32 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:30:33 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Jul 06 12:30:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.673s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:30:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:30:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:30:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:30:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:30:38 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=102,cinder:SELECT=62,cinder:INSERT=32,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:30:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=92,cinder:SELECT=73,cinder:INSERT=25,cinder:DELETE=12 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Flow 'volume_create_manager' (a6663a46-b158-46e9-b130-d1623fb14f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51fa886-2717-4e09-9488-e6a8a2973450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51fa886-2717-4e09-9488-e6a8a2973450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-402724816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85c0290-20e1-42fb-a05e-2fd209ba36b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='694e0e32a3da4223979f03d2ea79d21d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:13Z,use_quota=True,user_id='b25b675d31d9435d86e712de25c52e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9ffad2-26d7-47bb-9886-b984ee2b3ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9ffad2-26d7-47bb-9886-b984ee2b3ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2ad7b1-c4c1-4303-9e29-2dc3100aeb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2ad7b1-c4c1-4303-9e29-2dc3100aeb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c85c0290-20e1-42fb-a05e-2fd209ba36b5', 'volume_name': 'volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1887ca8-062a-402e-8747-94cfb45bf928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1887ca8-062a-402e-8747-94cfb45bf928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c5e477-a8a2-48c5-8db8-04a22dedbcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:13 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Volume c85c0290-20e1-42fb-a05e-2fd209ba36b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5', 'volume_size': 1} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-402724816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85c0290-20e1-42fb-a05e-2fd209ba36b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='694e0e32a3da4223979f03d2ea79d21d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:31:13Z,use_quota=True,user_id='b25b675d31d9435d86e712de25c52e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Creating volume c85c0290-20e1-42fb-a05e-2fd209ba36b5 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:31:13 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:31:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:13 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 1073741824 Jul 06 12:31:13 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:14 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 1073741824" returned: 0 in 0.879s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:14 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 Jul 06 12:31:14 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:15 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5" returned: 0 in 0.662s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:31:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c5e477-a8a2-48c5-8db8-04a22dedbcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa5be2e-3c4d-411c-86ce-a9c8f2e306cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:31:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Volume volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 (c85c0290-20e1-42fb-a05e-2fd209ba36b5): created successfully Jul 06 12:31:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa5be2e-3c4d-411c-86ce-a9c8f2e306cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:31:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Flow 'volume_create_manager' (a6663a46-b158-46e9-b130-d1623fb14f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:31:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-96f52f8b-511b-4cbf-8d9e-d8bf985308a2 tempest-TestMinimumBasicScenario-1980807916 None] Created volume successfully. Jul 06 12:31:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-25c5773e-7a68-4c83-802e-3d059f49c9e3 req-9e56fd88-1903-4ab8-9d37-418b71fd80ff tempest-TestMinimumBasicScenario-1980807916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-25c5773e-7a68-4c83-802e-3d059f49c9e3 req-9e56fd88-1903-4ab8-9d37-418b71fd80ff tempest-TestMinimumBasicScenario-1980807916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5679c7-66b7-4b31-8f6d-1df959a96697]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:31:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-25c5773e-7a68-4c83-802e-3d059f49c9e3 req-9e56fd88-1903-4ab8-9d37-418b71fd80ff tempest-TestMinimumBasicScenario-1980807916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:18 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 Jul 06 12:31:18 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:19 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-25c5773e-7a68-4c83-802e-3d059f49c9e3 req-9e56fd88-1903-4ab8-9d37-418b71fd80ff tempest-TestMinimumBasicScenario-1980807916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5" returned: 0 in 0.936s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-25c5773e-7a68-4c83-802e-3d059f49c9e3 req-9e56fd88-1903-4ab8-9d37-418b71fd80ff tempest-TestMinimumBasicScenario-1980807916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.958s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-25c5773e-7a68-4c83-802e-3d059f49c9e3 req-9e56fd88-1903-4ab8-9d37-418b71fd80ff tempest-TestMinimumBasicScenario-1980807916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c5cfdec-7a0c-43ef-8c87-4a3c3c27e325', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:31:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-25c5773e-7a68-4c83-802e-3d059f49c9e3 req-9e56fd88-1903-4ab8-9d37-418b71fd80ff tempest-TestMinimumBasicScenario-1980807916 None] attachment_update completed successfully. Jul 06 12:31:29 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=7,cinder:INSERT=1,cinder:SELECT=4 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:31:29 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:31:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:31:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:31:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:31:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:31:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:31:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:31:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:31:32 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:31:32 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:31:33 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jul 06 12:31:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.705s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:31:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:31:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:31:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:31:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:31:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:32:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-6a0c3c71-58eb-49c2-a824-8334aad77af5 req-736cdc3e-e847-4d32-8904-198a88d31d1e tempest-TestMinimumBasicScenario-1980807916 None] Terminate volume connection completed successfully. Jul 06 12:32:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-6a0c3c71-58eb-49c2-a824-8334aad77af5 req-736cdc3e-e847-4d32-8904-198a88d31d1e tempest-TestMinimumBasicScenario-1980807916 None] Deleting attachment 2c5cfdec-7a0c-43ef-8c87-4a3c3c27e325. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:32:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Acquiring lock "cinder-c85c0290-20e1-42fb-a05e-2fd209ba36b5-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Lock "cinder-c85c0290-20e1-42fb-a05e-2fd209ba36b5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Acquiring lock "cinder-quobyte-c85c0290-20e1-42fb-a05e-2fd209ba36b5" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:32:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Lock "cinder-quobyte-c85c0290-20e1-42fb-a05e-2fd209ba36b5" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:32:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00ccc39-9350-4fa8-b699-4cac5be7c955]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:32:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:10 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 Jul 06 12:32:10 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:11 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5" returned: 0 in 0.793s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:11 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5 Jul 06 12:32:11 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:12 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c85c0290-20e1-42fb-a05e-2fd209ba36b5" returned: 0 in 0.718s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Lock "cinder-quobyte-c85c0290-20e1-42fb-a05e-2fd209ba36b5" released by "delete_volume" :: held 1.555s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:12 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Created reservations ['a125a3e6-5df8-4462-92e5-79ac605f8179', 'c312cf1d-0960-498d-b355-62e1e022e00e', '57e52c5f-1bea-4b8e-bd90-125568ae748a', 'ba20b001-052d-45bf-995f-1583fb341d09'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:32:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:12 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:32:12 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:13 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.717s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:13 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Deleted volume successfully. Jul 06 12:32:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-eb21c774-b155-4cd9-8e11-fc6aa8e3024f tempest-TestMinimumBasicScenario-1980807916 None] Lock "cinder-c85c0290-20e1-42fb-a05e-2fd209ba36b5-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:32:22 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:32:23 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:32:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:32:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:32 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:32:32 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:33 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.738s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:32:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:32:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:32:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:32:48 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Flow 'volume_create_manager' (b63f1fd6-993b-41f5-85fe-d4b162f81901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445e93d2-45f7-4891-b053-961519b6c657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445e93d2-45f7-4891-b053-961519b6c657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2100059153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c581ead7-b19d-4995-ab94-65206d57b3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520383f4e17e43dd846982829f388656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:49Z,use_quota=True,user_id='6434ebd2121048efb4feaf32041252f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5c4937-70cb-41ac-8cee-4a3db37f7143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5c4937-70cb-41ac-8cee-4a3db37f7143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862e2a76-5a23-4284-921b-f44a0e37d6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862e2a76-5a23-4284-921b-f44a0e37d6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c581ead7-b19d-4995-ab94-65206d57b3f8', 'volume_name': 'volume-c581ead7-b19d-4995-ab94-65206d57b3f8', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a386794-4183-4aa2-90f1-2ff702c038dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a386794-4183-4aa2-90f1-2ff702c038dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12616539-969d-4a6c-ad08-16407eb559ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Volume c581ead7-b19d-4995-ab94-65206d57b3f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c581ead7-b19d-4995-ab94-65206d57b3f8', 'volume_size': 1} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2100059153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c581ead7-b19d-4995-ab94-65206d57b3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520383f4e17e43dd846982829f388656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:49Z,use_quota=True,user_id='6434ebd2121048efb4feaf32041252f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Creating volume c581ead7-b19d-4995-ab94-65206d57b3f8 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:49 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:49 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8 1073741824 Jul 06 12:32:49 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Flow 'volume_create_manager' (61b14a05-3136-4f49-be0d-d50bfcdb069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772162cc-67d0-43eb-ba61-833f1945aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (772162cc-67d0-43eb-ba61-833f1945aa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-763643116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0fe7c0-1e54-4607-bdbf-2d270a74732c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520383f4e17e43dd846982829f388656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:49Z,use_quota=True,user_id='6434ebd2121048efb4feaf32041252f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21402820-c75a-4395-9b1c-9cd9e1d3bf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21402820-c75a-4395-9b1c-9cd9e1d3bf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ff0767-0d85-4bda-846b-a99b7cb96023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ff0767-0d85-4bda-846b-a99b7cb96023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a0fe7c0-1e54-4607-bdbf-2d270a74732c', 'volume_name': 'volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0f044a-61cf-4616-97ad-af006019936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0f044a-61cf-4616-97ad-af006019936d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae00a46-eebc-4436-9aaf-116915ce0030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:49 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Volume 6a0fe7c0-1e54-4607-bdbf-2d270a74732c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c', 'volume_size': 1} Jul 06 12:32:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:50 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8 1073741824" returned: 0 in 1.054s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:50 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8 Jul 06 12:32:50 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:50 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8" returned: 0 in 0.727s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.406s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-763643116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0fe7c0-1e54-4607-bdbf-2d270a74732c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='520383f4e17e43dd846982829f388656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:32:49Z,use_quota=True,user_id='6434ebd2121048efb4feaf32041252f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Creating volume 6a0fe7c0-1e54-4607-bdbf-2d270a74732c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:32:50 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12616539-969d-4a6c-ad08-16407eb559ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c581ead7-b19d-4995-ab94-65206d57b3f8', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1094293-3af9-451c-a58e-de93f4b20cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:50 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c 1073741824 Jul 06 12:32:50 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Volume volume-c581ead7-b19d-4995-ab94-65206d57b3f8 (c581ead7-b19d-4995-ab94-65206d57b3f8): created successfully Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1094293-3af9-451c-a58e-de93f4b20cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Flow 'volume_create_manager' (b63f1fd6-993b-41f5-85fe-d4b162f81901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b3854d17-b6bd-4d16-be47-65ad16d37c74 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Created volume successfully. Jul 06 12:32:51 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c 1073741824" returned: 0 in 0.961s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:32:51 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c Jul 06 12:32:51 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:32:52 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jul 06 12:32:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c" returned: 0 in 0.707s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:32:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:32:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:32:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae00a46-eebc-4436-9aaf-116915ce0030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed5903f-292b-48e9-9113-4fcbf5b11a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:32:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Volume volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c (6a0fe7c0-1e54-4607-bdbf-2d270a74732c): created successfully Jul 06 12:32:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed5903f-292b-48e9-9113-4fcbf5b11a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:32:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Flow 'volume_create_manager' (61b14a05-3136-4f49-be0d-d50bfcdb069c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:32:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3f9eb5bd-2dbc-4ccd-96f1-68b2657eb43c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Created volume successfully. Jul 06 12:33:02 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:33:02 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:33:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:33:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:33:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:33:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:32 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:33:32 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:33 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.699s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:33:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:33:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:33:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:33:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-63c81e72-6d6f-49d2-8a4d-2be781daded3 req-81652106-274d-471c-889b-65476df3e85c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-63c81e72-6d6f-49d2-8a4d-2be781daded3 req-81652106-274d-471c-889b-65476df3e85c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18892c5-8c31-449e-9c70-fe980424f635]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-63c81e72-6d6f-49d2-8a4d-2be781daded3 req-81652106-274d-471c-889b-65476df3e85c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:35 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8 Jul 06 12:33:35 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:35 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-63c81e72-6d6f-49d2-8a4d-2be781daded3 req-81652106-274d-471c-889b-65476df3e85c tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8" returned: 0 in 0.809s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-63c81e72-6d6f-49d2-8a4d-2be781daded3 req-81652106-274d-471c-889b-65476df3e85c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-63c81e72-6d6f-49d2-8a4d-2be781daded3 req-81652106-274d-471c-889b-65476df3e85c tempest-TestServerVolumeAttachmentScenario-1182096764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-c581ead7-b19d-4995-ab94-65206d57b3f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e51934c1-2413-4b29-856c-f56ea7fb4489', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:33:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-63c81e72-6d6f-49d2-8a4d-2be781daded3 req-81652106-274d-471c-889b-65476df3e85c tempest-TestServerVolumeAttachmentScenario-1182096764 None] attachment_update completed successfully. Jul 06 12:33:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f9588c5f-b8a7-452b-a582-471cce11c767 req-2b70b486-1f60-48c0-99e6-4ae112eb20ab tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:33:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f9588c5f-b8a7-452b-a582-471cce11c767 req-2b70b486-1f60-48c0-99e6-4ae112eb20ab tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:33:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba853a8-d85c-42f8-87c7-75feacd95084]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:33:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-f9588c5f-b8a7-452b-a582-471cce11c767 req-2b70b486-1f60-48c0-99e6-4ae112eb20ab tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:33:44 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c Jul 06 12:33:44 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:33:45 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jul 06 12:33:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-f9588c5f-b8a7-452b-a582-471cce11c767 req-2b70b486-1f60-48c0-99e6-4ae112eb20ab tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c" returned: 0 in 0.795s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:33:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-f9588c5f-b8a7-452b-a582-471cce11c767 req-2b70b486-1f60-48c0-99e6-4ae112eb20ab tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.812s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:33:45 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-f9588c5f-b8a7-452b-a582-471cce11c767 req-2b70b486-1f60-48c0-99e6-4ae112eb20ab tempest-TestServerVolumeAttachmentScenario-1182096764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52a7217d-90d4-4f46-952f-3f023eb7081d', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:33:45 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-f9588c5f-b8a7-452b-a582-471cce11c767 req-2b70b486-1f60-48c0-99e6-4ae112eb20ab tempest-TestServerVolumeAttachmentScenario-1182096764 None] attachment_update completed successfully. Jul 06 12:33:51 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-76add6e5-5480-4d9c-9778-243fbbce6d3a req-308d4166-18cc-474a-a043-a110279f397b tempest-TestServerVolumeAttachmentScenario-1182096764 None] Terminate volume connection completed successfully. Jul 06 12:33:51 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-76add6e5-5480-4d9c-9778-243fbbce6d3a req-308d4166-18cc-474a-a043-a110279f397b tempest-TestServerVolumeAttachmentScenario-1182096764 None] Deleting attachment 52a7217d-90d4-4f46-952f-3f023eb7081d. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:33:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-fc278a48-17aa-4e89-8bda-18452292722a req-d311e41a-7d79-404b-b64f-c2f5aefc377a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Terminate volume connection completed successfully. Jul 06 12:33:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-fc278a48-17aa-4e89-8bda-18452292722a req-d311e41a-7d79-404b-b64f-c2f5aefc377a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Deleting attachment e51934c1-2413-4b29-856c-f56ea7fb4489. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:34:01 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:34:05 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=4,cinder:SELECT=15 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:34:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "cinder-6a0fe7c0-1e54-4607-bdbf-2d270a74732c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "cinder-6a0fe7c0-1e54-4607-bdbf-2d270a74732c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "cinder-quobyte-6a0fe7c0-1e54-4607-bdbf-2d270a74732c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "cinder-quobyte-6a0fe7c0-1e54-4607-bdbf-2d270a74732c" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a018a213-2a10-4890-8786-e06df0b3595d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:06 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c Jul 06 12:34:06 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:06 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c" returned: 0 in 0.810s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:07 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c Jul 06 12:34:07 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:07 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6a0fe7c0-1e54-4607-bdbf-2d270a74732c" returned: 0 in 0.816s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "cinder-quobyte-6a0fe7c0-1e54-4607-bdbf-2d270a74732c" released by "delete_volume" :: held 1.674s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:07 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Created reservations ['d27c0757-ed1e-4379-8d83-4dc7a47fb84e', 'ed37e9ed-b45b-49f2-968d-fc572aff0df4', '3dffc2a9-b4c5-4655-ab80-16cfa5e0c8e3', 'c13e078d-7180-49df-a6e2-3f3573c42d37'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:07 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:34:07 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "cinder-c581ead7-b19d-4995-ab94-65206d57b3f8-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "cinder-c581ead7-b19d-4995-ab94-65206d57b3f8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "cinder-quobyte-c581ead7-b19d-4995-ab94-65206d57b3f8" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:34:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "cinder-quobyte-c581ead7-b19d-4995-ab94-65206d57b3f8" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:34:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c94c83-4212-4ec6-bd65-9c7e913bb386]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:08 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8 Jul 06 12:34:08 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:08 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.780s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:08 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Deleted volume successfully. Jul 06 12:34:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-48d0c722-f7bf-45bb-8253-88367a029a6a tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "cinder-6a0fe7c0-1e54-4607-bdbf-2d270a74732c-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:09 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8" returned: 0 in 0.817s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:09 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8 Jul 06 12:34:09 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:10 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c581ead7-b19d-4995-ab94-65206d57b3f8" returned: 0 in 0.802s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "cinder-quobyte-c581ead7-b19d-4995-ab94-65206d57b3f8" released by "delete_volume" :: held 1.670s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:10 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Created reservations ['494a80d0-f50f-4538-b533-d53aa0ffe135', '43a634fd-ea8e-4513-ac18-6b56ee9408b1', '1be7f48a-e6a6-4fd3-b791-e34d26c63f83', '7dfc5d08-7df1-4fed-8e9f-80f02621c758'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:34:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:10 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:34:10 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:10 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.728s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:10 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Deleted volume successfully. Jul 06 12:34:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-dbce9804-c7df-45d4-a707-e01877edb9e9 tempest-TestServerVolumeAttachmentScenario-1182096764 None] Lock "cinder-c581ead7-b19d-4995-ab94-65206d57b3f8-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:34:20 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=16,cinder:SELECT=11,cinder:INSERT=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:34:20 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=9,cinder:INSERT=5,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:34:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:34:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:32 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:34:32 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:33 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.834s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:34:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:34:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:34:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Flow 'volume_create_manager' (60b0804a-3456-4df8-8ead-f8544e1e1f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847a2429-6617-4a39-b340-bb5a36a04d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847a2429-6617-4a39-b340-bb5a36a04d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-919993436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c395f80c-9f4b-4230-ae76-abdb33039b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6283087f4f47138366124bd2b8b95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:47Z,use_quota=True,user_id='5e57c6d243564b5e9cd515c807e9ea7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d968e7d5-d5d1-419d-bb08-15d03e99d787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d968e7d5-d5d1-419d-bb08-15d03e99d787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5064ee0a-69f8-484e-9b3d-8aa1225cdaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5064ee0a-69f8-484e-9b3d-8aa1225cdaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c395f80c-9f4b-4230-ae76-abdb33039b8d', 'volume_name': 'volume-c395f80c-9f4b-4230-ae76-abdb33039b8d', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdc01f2-ed67-407c-8c31-ca1497415616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdc01f2-ed67-407c-8c31-ca1497415616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990cd31b-5c9d-4d94-b99c-334f599ce927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:47 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Volume c395f80c-9f4b-4230-ae76-abdb33039b8d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c395f80c-9f4b-4230-ae76-abdb33039b8d', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 12:34:47 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Trying to clone c395f80c-9f4b-4230-ae76-abdb33039b8d from image b5606d26-431d-46eb-8401-a0b1e0a3d067 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:34:48 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:34:48 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Image download 20.69 MB at 20.69 MB/s Jul 06 12:34:48 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a0a98-fd82-4958-8b9d-778908c5c63f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:48 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD Jul 06 12:34:48 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:48 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD" returned: 0 in 0.747s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:48 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Temporary image b5606d26-431d-46eb-8401-a0b1e0a3d067 is fetched for user 5e57c6d243564b5e9cd515c807e9ea7f. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66eb914-7063-41a5-89b8-ed899e3eab87]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:49 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD Jul 06 12:34:49 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:49 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD" returned: 0 in 0.839s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-919993436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c395f80c-9f4b-4230-ae76-abdb33039b8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb6283087f4f47138366124bd2b8b95b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:34:47Z,use_quota=True,user_id='5e57c6d243564b5e9cd515c807e9ea7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Creating volume c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:34:49 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:34:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:49 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d 1073741824 Jul 06 12:34:49 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:50 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d 1073741824" returned: 0 in 0.864s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:50 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d Jul 06 12:34:50 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:51 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d" returned: 0 in 0.716s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:34:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:34:51 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Attempting download of b5606d26-431d-46eb-8401-a0b1e0a3d067 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}])) to volume c395f80c-9f4b-4230-ae76-abdb33039b8d. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:34:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18b8cf3-a891-4858-9a1a-a63bcb1cce4f]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_mqg35q9g {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:51 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_mqg35q9g Jul 06 12:34:51 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:52 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_mqg35q9g" returned: 0 in 0.773s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_mqg35q9g {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:52 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_mqg35q9g Jul 06 12:34:52 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:53 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_mqg35q9g" returned: 1 in 0.764s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5606d26-431d-46eb-8401-a0b1e0a3d067_mqg35q9g' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:34:53 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11e1a64-1e5e-4b37-931a-286e3298217b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:53 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD Jul 06 12:34:53 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:53 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:53 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] b5606d26-431d-46eb-8401-a0b1e0a3d067 was qcow2, converting to raw {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:34:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:53 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d Jul 06 12:34:53 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:55 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d" returned: 0 in 1.953s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:55 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5606d26-431d-46eb-8401-a0b1e0a3d067_uvffg8qbdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:34:55 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Converted 112.00 MB image at 57.31 MB/s Jul 06 12:34:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:55 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d 1G Jul 06 12:34:55 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:56 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d 1G" returned: 0 in 0.682s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:56 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bb9aeb-edbd-4be0-9ff0-01fdf4a2c591]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:34:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:56 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d Jul 06 12:34:56 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:57 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d" returned: 0 in 0.784s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:34:57 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d Jul 06 12:34:57 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:34:58 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 06 12:34:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d" returned: 1 in 0.795s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:34:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:34:58 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Downloaded image b5606d26-431d-46eb-8401-a0b1e0a3d067 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}])) to volume c395f80c-9f4b-4230-ae76-abdb33039b8d successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:34:58 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Temporary image b5606d26-431d-46eb-8401-a0b1e0a3d067 for user 5e57c6d243564b5e9cd515c807e9ea7f is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:34:58 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Marking volume c395f80c-9f4b-4230-ae76-abdb33039b8d as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:34:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Copying metadata from image b5606d26-431d-46eb-8401-a0b1e0a3d067 to c395f80c-9f4b-4230-ae76-abdb33039b8d. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:34:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Creating volume glance metadata for volume c395f80c-9f4b-4230-ae76-abdb33039b8d backed by image b5606d26-431d-46eb-8401-a0b1e0a3d067 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:34:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990cd31b-5c9d-4d94-b99c-334f599ce927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c395f80c-9f4b-4230-ae76-abdb33039b8d', 'volume_size': 1, 'image_id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5606d26-431d-46eb-8401-a0b1e0a3d067', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6f815dc25c54c9d945d484f5e72ab1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5606d26-431d-46eb-8401-a0b1e0a3d067', 'created_at': datetime.datetime(2026, 7, 6, 10, 2, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 2, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5606d26-431d-46eb-8401-a0b1e0a3d067/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1caa662-0c33-4d93-b0ec-9e1ffd4d5135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:34:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Volume volume-c395f80c-9f4b-4230-ae76-abdb33039b8d (c395f80c-9f4b-4230-ae76-abdb33039b8d): created successfully Jul 06 12:34:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1caa662-0c33-4d93-b0ec-9e1ffd4d5135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:34:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Flow 'volume_create_manager' (60b0804a-3456-4df8-8ead-f8544e1e1f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:34:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f01d0ffd-5fb4-4218-89c7-aa3677e5df34 tempest-TestShelveInstance-305920632 None] Created volume successfully. Jul 06 12:35:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-50ca4c6d-6816-460c-ac21-bbc9d823cddb req-f286bc5b-ac1a-438e-a850-7d5646711b48 tempest-TestShelveInstance-305920632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-50ca4c6d-6816-460c-ac21-bbc9d823cddb req-f286bc5b-ac1a-438e-a850-7d5646711b48 tempest-TestShelveInstance-305920632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f8fbfd-7735-4b7e-a8d1-179d238f065d]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-50ca4c6d-6816-460c-ac21-bbc9d823cddb req-f286bc5b-ac1a-438e-a850-7d5646711b48 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:06 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d Jul 06 12:35:06 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:07 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-50ca4c6d-6816-460c-ac21-bbc9d823cddb req-f286bc5b-ac1a-438e-a850-7d5646711b48 tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d" returned: 0 in 0.878s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-50ca4c6d-6816-460c-ac21-bbc9d823cddb req-f286bc5b-ac1a-438e-a850-7d5646711b48 tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:07 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d Jul 06 12:35:07 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:07 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-50ca4c6d-6816-460c-ac21-bbc9d823cddb req-f286bc5b-ac1a-438e-a850-7d5646711b48 tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d" returned: 1 in 0.757s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-50ca4c6d-6816-460c-ac21-bbc9d823cddb req-f286bc5b-ac1a-438e-a850-7d5646711b48 tempest-TestShelveInstance-305920632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:35:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-50ca4c6d-6816-460c-ac21-bbc9d823cddb req-f286bc5b-ac1a-438e-a850-7d5646711b48 tempest-TestShelveInstance-305920632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.676s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-50ca4c6d-6816-460c-ac21-bbc9d823cddb req-f286bc5b-ac1a-438e-a850-7d5646711b48 tempest-TestShelveInstance-305920632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-c395f80c-9f4b-4230-ae76-abdb33039b8d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15e785d3-a892-4fa0-b5e5-b1f1e2dc778b', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:35:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-50ca4c6d-6816-460c-ac21-bbc9d823cddb req-f286bc5b-ac1a-438e-a850-7d5646711b48 tempest-TestShelveInstance-305920632 None] attachment_update completed successfully. Jul 06 12:35:17 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=9 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:35:17 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:35:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:35:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:35:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:35:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:32 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:35:32 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:33 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.675s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:35:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:35:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:35:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:35:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:35:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:35:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-a246d822-cfba-40d9-a59a-ed26f3580463 req-2501ccf3-cca0-4031-a723-1ffd7351cd83 tempest-TestShelveInstance-305920632 None] Terminate volume connection completed successfully. Jul 06 12:35:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-a246d822-cfba-40d9-a59a-ed26f3580463 req-2501ccf3-cca0-4031-a723-1ffd7351cd83 tempest-TestShelveInstance-305920632 None] Deleting attachment 15e785d3-a892-4fa0-b5e5-b1f1e2dc778b. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:35:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-d49e7a74-cbbb-4abc-8cb9-36d88697269c req-d6d945a4-e1ba-4ce4-bf78-126338a765aa tempest-TestShelveInstance-305920632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:35:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-d49e7a74-cbbb-4abc-8cb9-36d88697269c req-d6d945a4-e1ba-4ce4-bf78-126338a765aa tempest-TestShelveInstance-305920632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:35:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cefff5-78e9-4acb-8db0-d40abec073fc]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:35:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-d49e7a74-cbbb-4abc-8cb9-36d88697269c req-d6d945a4-e1ba-4ce4-bf78-126338a765aa tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:49 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d Jul 06 12:35:49 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:49 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-d49e7a74-cbbb-4abc-8cb9-36d88697269c req-d6d945a4-e1ba-4ce4-bf78-126338a765aa tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d" returned: 0 in 0.785s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-d49e7a74-cbbb-4abc-8cb9-36d88697269c req-d6d945a4-e1ba-4ce4-bf78-126338a765aa tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:35:49 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d Jul 06 12:35:49 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:35:50 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 06 12:35:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-d49e7a74-cbbb-4abc-8cb9-36d88697269c req-d6d945a4-e1ba-4ce4-bf78-126338a765aa tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d" returned: 1 in 0.828s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:35:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-d49e7a74-cbbb-4abc-8cb9-36d88697269c req-d6d945a4-e1ba-4ce4-bf78-126338a765aa tempest-TestShelveInstance-305920632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:35:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-d49e7a74-cbbb-4abc-8cb9-36d88697269c req-d6d945a4-e1ba-4ce4-bf78-126338a765aa tempest-TestShelveInstance-305920632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.655s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:35:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-d49e7a74-cbbb-4abc-8cb9-36d88697269c req-d6d945a4-e1ba-4ce4-bf78-126338a765aa tempest-TestShelveInstance-305920632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131', 'name': 'volume-c395f80c-9f4b-4230-ae76-abdb33039b8d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a6852f2-9262-4bf2-b31b-2ee2f54a63a3', 'enforce_multipath': True} {{(pid=86561) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 12:35:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-d49e7a74-cbbb-4abc-8cb9-36d88697269c req-d6d945a4-e1ba-4ce4-bf78-126338a765aa tempest-TestShelveInstance-305920632 None] attachment_update completed successfully. Jul 06 12:36:00 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:36:00 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:36:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-24da6967-c564-497c-aa89-4ca6878a0cb2 tempest-TestShelveInstance-305920632 None] Terminate volume connection completed successfully. Jul 06 12:36:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-24da6967-c564-497c-aa89-4ca6878a0cb2 tempest-TestShelveInstance-305920632 None] Deleting attachment 3a6852f2-9262-4bf2-b31b-2ee2f54a63a3. {{(pid=86561) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Acquiring lock "cinder-c395f80c-9f4b-4230-ae76-abdb33039b8d-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Lock "cinder-c395f80c-9f4b-4230-ae76-abdb33039b8d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Acquiring lock "cinder-quobyte-c395f80c-9f4b-4230-ae76-abdb33039b8d" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Lock "cinder-quobyte-c395f80c-9f4b-4230-ae76-abdb33039b8d" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fba3e46-412f-437b-ac1e-584c67429a32]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:32 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d Jul 06 12:36:32 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:32 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:36:32 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:33 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d" returned: 0 in 0.849s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:33 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d Jul 06 12:36:33 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:33 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.768s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:36:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:36:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:36:33 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d" returned: 1 in 0.883s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:36:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:33 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d Jul 06 12:36:33 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:34 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-c395f80c-9f4b-4230-ae76-abdb33039b8d" returned: 0 in 0.704s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Lock "cinder-quobyte-c395f80c-9f4b-4230-ae76-abdb33039b8d" released by "delete_volume" :: held 2.509s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:34 devstack cinder-volume[86561]: DEBUG cinder.quota [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Created reservations ['07831e3f-77ab-418b-a641-eff8f902792a', 'f24e34d3-c48e-4305-adaa-548263a47d4e', 'c02fecc4-a634-4377-82f6-b512a9d8de54', '4ccd445d-8207-491f-820d-90f59ad9cf03'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:36:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:34 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:36:34 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:35 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.798s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:35 devstack cinder-volume[86561]: DEBUG cinder.manager [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:36:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Deleted volume successfully. Jul 06 12:36:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [req-95b95e82-44f4-4311-a4f8-fd4ea335051a req-ffbe7a64-14e3-413b-8864-96cd633046cd tempest-TestShelveInstance-305920632 None] Lock "cinder-c395f80c-9f4b-4230-ae76-abdb33039b8d-delete_volume" released by "delete_volume" :: held 3.610s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:36:44 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:36:45 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (ed12b19d-7942-410b-9954-39dc4b5d3989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861afeff-299a-466f-9b62-0559a1308939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861afeff-299a-466f-9b62-0559a1308939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1854547998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9d8399-e7d0-4f0e-ad0a-69ff05962005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:47Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a382924-6b3a-4b6f-9e89-c70eb13b2513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a382924-6b3a-4b6f-9e89-c70eb13b2513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e279f64-13af-4ace-b4da-a9a25c441e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e279f64-13af-4ace-b4da-a9a25c441e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9d8399-e7d0-4f0e-ad0a-69ff05962005', 'volume_name': 'volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e175918b-a577-4c49-ad10-d79d209db127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e175918b-a577-4c49-ad10-d79d209db127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a8f039-6aa6-4935-a74e-b813dfb04716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:47 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume 3b9d8399-e7d0-4f0e-ad0a-69ff05962005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005', 'volume_size': 1} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1854547998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9d8399-e7d0-4f0e-ad0a-69ff05962005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:47Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Creating volume 3b9d8399-e7d0-4f0e-ad0a-69ff05962005 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:47 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:47 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 1073741824 Jul 06 12:36:47 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:47 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 1073741824" returned: 0 in 0.878s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:48 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 Jul 06 12:36:48 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:48 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005" returned: 0 in 0.642s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a8f039-6aa6-4935-a74e-b813dfb04716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668f7bfc-1dc6-4a30-9175-b97e6f548117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:48 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 (3b9d8399-e7d0-4f0e-ad0a-69ff05962005): created successfully Jul 06 12:36:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668f7bfc-1dc6-4a30-9175-b97e6f548117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (ed12b19d-7942-410b-9954-39dc4b5d3989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:48 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-83f14082-7fb9-4f38-9e3e-a5103f8accdd tempest-CreateVolumesFromSnapshotTest-935359099 None] Created volume successfully. Jul 06 12:36:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] Creating offline snapshot 01925db6-fa41-45a3-a981-21dedbac4737 of volume 3b9d8399-e7d0-4f0e-ad0a-69ff05962005 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:36:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b515e9c-ff3e-44b7-9f7f-9288b67394ae]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:36:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:49 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 Jul 06 12:36:49 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:50 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005" returned: 0 in 0.793s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:50 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 1G Jul 06 12:36:50 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:50 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 1G" returned: 0 in 0.835s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:50 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 Jul 06 12:36:50 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:51 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737" returned: 0 in 0.709s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:51 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 is being set with open permissions: ugo+rw Jul 06 12:36:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:51 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 Jul 06 12:36:51 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:52 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737" returned: 0 in 0.642s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:52 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.info Jul 06 12:36:52 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:52 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.info" returned: 0 in 0.681s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:53 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.info is being set with open permissions: ugo+rw Jul 06 12:36:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:53 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.info Jul 06 12:36:53 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:53 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.info" returned: 0 in 0.671s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.411s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-29f35a2c-a138-4bc8-972b-362a48aabb48 tempest-CreateVolumesFromSnapshotTest-935359099 None] Create snapshot completed successfully Jul 06 12:36:54 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (d3d3bde6-6082-47c1-988f-81ab23f70538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f7d24e-a418-4b57-b439-3d3368a69d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f7d24e-a418-4b57-b439-3d3368a69d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878109592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5df7cfe-ecd7-48be-ae80-27aad270ca3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:55Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856a840f-0fb6-48ed-9b2d-80612dd7c322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856a840f-0fb6-48ed-9b2d-80612dd7c322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c16b6a-2c5b-49cb-bc7e-e58cc4a32c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c16b6a-2c5b-49cb-bc7e-e58cc4a32c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5df7cfe-ecd7-48be-ae80-27aad270ca3a', 'volume_name': 'volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ddd419-2b12-40fe-9395-7a26b5b33d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ddd419-2b12-40fe-9395-7a26b5b33d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700b4d66-6f2e-468f-a16c-0f976772ceac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume a5df7cfe-ecd7-48be-ae80-27aad270ca3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a', 'volume_size': 1} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878109592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5df7cfe-ecd7-48be-ae80-27aad270ca3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:55Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Creating volume a5df7cfe-ecd7-48be-ae80-27aad270ca3a {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:55 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:55 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a 1073741824 Jul 06 12:36:55 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (075b0c61-8fec-404b-bd2a-bf24a8d52f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9701d75b-cc91-4fe7-b393-0f13b5896581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9701d75b-cc91-4fe7-b393-0f13b5896581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-940227436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad3643e-f604-4657-9220-3448a1bba3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:55Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607a7f51-77ec-41fc-b2b6-e8f991dd47b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607a7f51-77ec-41fc-b2b6-e8f991dd47b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9272be40-c3a3-4895-8c9d-f0f26d1d595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9272be40-c3a3-4895-8c9d-f0f26d1d595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad3643e-f604-4657-9220-3448a1bba3ee', 'volume_name': 'volume-cad3643e-f604-4657-9220-3448a1bba3ee', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6c5c72-1aa3-4de3-9d8f-8128362b016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6c5c72-1aa3-4de3-9d8f-8128362b016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57701548-ec60-4720-b843-854dc55f38cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume cad3643e-f604-4657-9220-3448a1bba3ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad3643e-f604-4657-9220-3448a1bba3ee', 'volume_size': 1} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (009d3211-1fa4-49e9-82be-272b3a4e6c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2f17a6-2b57-4065-b688-7967bb6f2255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2f17a6-2b57-4065-b688-7967bb6f2255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1155333748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a67576-aeb2-478d-a271-f9ca0d1cd972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:56Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618abccb-4f32-49a2-9e4d-c364c1b8a3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618abccb-4f32-49a2-9e4d-c364c1b8a3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998a7152-1222-4041-bf04-dce54f31f7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998a7152-1222-4041-bf04-dce54f31f7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a67576-aeb2-478d-a271-f9ca0d1cd972', 'volume_name': 'volume-32a67576-aeb2-478d-a271-f9ca0d1cd972', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97fa539-4fa4-4190-a5e5-7d5ceb716636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97fa539-4fa4-4190-a5e5-7d5ceb716636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae069443-b715-48d4-9b51-1e24de6ed6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume 32a67576-aeb2-478d-a271-f9ca0d1cd972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a67576-aeb2-478d-a271-f9ca0d1cd972', 'volume_size': 1} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:56 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a 1073741824" returned: 0 in 1.109s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:56 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a Jul 06 12:36:56 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (38a467cd-a7c7-43e9-ad40-4f03a80b74b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9343d82-bacc-47e0-8a1d-f57fc4d01d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9343d82-bacc-47e0-8a1d-f57fc4d01d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293946933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b8c471-abec-49ca-b8be-31bed0e48267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:56Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfaebb2-bdde-46ea-bf2d-9c8417c4b98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfaebb2-bdde-46ea-bf2d-9c8417c4b98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2226e317-0ef8-4714-9b7a-386c28d1e24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2226e317-0ef8-4714-9b7a-386c28d1e24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1b8c471-abec-49ca-b8be-31bed0e48267', 'volume_name': 'volume-b1b8c471-abec-49ca-b8be-31bed0e48267', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34320e94-cf91-41b2-a124-e285a5391ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34320e94-cf91-41b2-a124-e285a5391ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56622035-6aaa-4082-8dec-320cde98d51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume b1b8c471-abec-49ca-b8be-31bed0e48267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1b8c471-abec-49ca-b8be-31bed0e48267', 'volume_size': 1} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (6acc55a6-23d2-4399-8a78-fd2e6d0a8c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a04d78-d82d-4c97-a255-2f860c41f237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a04d78-d82d-4c97-a255-2f860c41f237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-477760842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226f0e8f-ec46-4849-bbf7-e108ccfb63f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:57Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578c5a0c-22c3-45c3-814a-2982582c8738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578c5a0c-22c3-45c3-814a-2982582c8738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8654a8a-d03e-4992-a2b6-0ac8f2465421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8654a8a-d03e-4992-a2b6-0ac8f2465421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '226f0e8f-ec46-4849-bbf7-e108ccfb63f6', 'volume_name': 'volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be18415-5c61-47cb-bf9a-ac27e33d01e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be18415-5c61-47cb-bf9a-ac27e33d01e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b135602e-0f35-4a5a-af25-5944aebf3702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume 226f0e8f-ec46-4849-bbf7-e108ccfb63f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6', 'volume_size': 1} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:56 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a" returned: 0 in 0.690s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.342s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-940227436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad3643e-f604-4657-9220-3448a1bba3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:55Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Creating volume cad3643e-f604-4657-9220-3448a1bba3ee {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:56 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:56 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee 1073741824 Jul 06 12:36:56 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700b4d66-6f2e-468f-a16c-0f976772ceac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:56 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9afb54-3d8d-439f-9729-2e14daec9f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:56 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a (a5df7cfe-ecd7-48be-ae80-27aad270ca3a): created successfully Jul 06 12:36:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9afb54-3d8d-439f-9729-2e14daec9f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (d3d3bde6-6082-47c1-988f-81ab23f70538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0ff361fb-7f8d-4920-a083-873c0e63f4f2 tempest-CreateVolumesFromSnapshotTest-935359099 None] Created volume successfully. Jul 06 12:36:57 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee 1073741824" returned: 0 in 0.900s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:57 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee Jul 06 12:36:57 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:58 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee" returned: 0 in 0.690s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.546s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1155333748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a67576-aeb2-478d-a271-f9ca0d1cd972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:56Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Creating volume 32a67576-aeb2-478d-a271-f9ca0d1cd972 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:36:58 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:58 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972 1073741824 Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57701548-ec60-4720-b843-854dc55f38cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad3643e-f604-4657-9220-3448a1bba3ee', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:58 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1146e2ff-f12d-4947-addc-e34da9b7fe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:36:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume volume-cad3643e-f604-4657-9220-3448a1bba3ee (cad3643e-f604-4657-9220-3448a1bba3ee): created successfully Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1146e2ff-f12d-4947-addc-e34da9b7fe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:36:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (075b0c61-8fec-404b-bd2a-bf24a8d52f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:36:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d1cbf126-0151-4e66-992c-c82b578ddb99 tempest-CreateVolumesFromSnapshotTest-935359099 None] Created volume successfully. Jul 06 12:36:59 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 06 12:36:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972 1073741824" returned: 0 in 0.889s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:36:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:36:59 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972 Jul 06 12:36:59 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:00 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972" returned: 0 in 0.643s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.699s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293946933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b8c471-abec-49ca-b8be-31bed0e48267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:56Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Creating volume b1b8c471-abec-49ca-b8be-31bed0e48267 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:00 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae069443-b715-48d4-9b51-1e24de6ed6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a67576-aeb2-478d-a271-f9ca0d1cd972', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:00 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267 1073741824 Jul 06 12:37:00 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00c0182-17ff-468c-9486-addc992d1498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:00 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume volume-32a67576-aeb2-478d-a271-f9ca0d1cd972 (32a67576-aeb2-478d-a271-f9ca0d1cd972): created successfully Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00c0182-17ff-468c-9486-addc992d1498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:00 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (009d3211-1fa4-49e9-82be-272b3a4e6c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2da6db68-37df-4a91-a0dc-9495e627e49f tempest-CreateVolumesFromSnapshotTest-935359099 None] Created volume successfully. Jul 06 12:37:01 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267 1073741824" returned: 0 in 0.883s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:01 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267 Jul 06 12:37:01 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:01 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267" returned: 0 in 0.686s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.960s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-477760842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226f0e8f-ec46-4849-bbf7-e108ccfb63f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f07861613c6418295426cb4bdbdbd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:36:57Z,use_quota=True,user_id='442b2b463beb46e4ab344b76eac1556c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Creating volume 226f0e8f-ec46-4849-bbf7-e108ccfb63f6 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:01 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:01 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6 1073741824 Jul 06 12:37:01 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56622035-6aaa-4082-8dec-320cde98d51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b8c471-abec-49ca-b8be-31bed0e48267', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a15a85d-2d0b-44a2-b5d0-7bf58070f2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume volume-b1b8c471-abec-49ca-b8be-31bed0e48267 (b1b8c471-abec-49ca-b8be-31bed0e48267): created successfully Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a15a85d-2d0b-44a2-b5d0-7bf58070f2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (38a467cd-a7c7-43e9-ad40-4f03a80b74b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e9e1613d-0f64-46c6-a7b9-4f9675d2385e tempest-CreateVolumesFromSnapshotTest-935359099 None] Created volume successfully. Jul 06 12:37:02 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6 1073741824" returned: 0 in 0.925s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:02 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6 Jul 06 12:37:02 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:03 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6" returned: 0 in 0.704s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b135602e-0f35-4a5a-af25-5944aebf3702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22ca377-4b96-44e7-b884-90a49af005bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:03 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Volume volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6 (226f0e8f-ec46-4849-bbf7-e108ccfb63f6): created successfully Jul 06 12:37:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22ca377-4b96-44e7-b884-90a49af005bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Flow 'volume_create_manager' (6acc55a6-23d2-4399-8a78-fd2e6d0a8c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1f4deecd-f6eb-4c83-8c18-212617ed02d8 tempest-CreateVolumesFromSnapshotTest-935359099 None] Created volume successfully. Jul 06 12:37:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-226f0e8f-ec46-4849-bbf7-e108ccfb63f6-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-226f0e8f-ec46-4849-bbf7-e108ccfb63f6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-quobyte-226f0e8f-ec46-4849-bbf7-e108ccfb63f6" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-226f0e8f-ec46-4849-bbf7-e108ccfb63f6" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:04 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a76b19b-927a-46d2-be8d-7e64f6630c05]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:04 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6 Jul 06 12:37:04 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:05 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6" returned: 0 in 0.842s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:05 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6 Jul 06 12:37:05 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:06 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-226f0e8f-ec46-4849-bbf7-e108ccfb63f6" returned: 0 in 0.711s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-226f0e8f-ec46-4849-bbf7-e108ccfb63f6" released by "delete_volume" :: held 1.593s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Created reservations ['45400d95-9a9e-4196-85ce-775f2954b811', 'b8f0f3f6-b8c3-4188-ad6d-a8457a6385d5', 'f554e24a-4951-4da0-943b-d44de64fb4f9', '9fcb084d-7753-4751-bf8d-64fa40e22f92'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:06 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:37:06 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-b1b8c471-abec-49ca-b8be-31bed0e48267-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-b1b8c471-abec-49ca-b8be-31bed0e48267-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-quobyte-b1b8c471-abec-49ca-b8be-31bed0e48267" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-b1b8c471-abec-49ca-b8be-31bed0e48267" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d5f012-689f-4ccc-9dca-418b87297ca7]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:07 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.718s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:07 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:07 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267 Jul 06 12:37:07 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Deleted volume successfully. Jul 06 12:37:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ac76f913-25fd-4b10-b540-f29846214cf4 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-226f0e8f-ec46-4849-bbf7-e108ccfb63f6-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:07 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267" returned: 0 in 0.789s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:07 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267 Jul 06 12:37:07 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:08 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b1b8c471-abec-49ca-b8be-31bed0e48267" returned: 0 in 0.714s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-b1b8c471-abec-49ca-b8be-31bed0e48267" released by "delete_volume" :: held 1.544s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Created reservations ['f39729b6-8f21-499f-b035-9d2140f805b9', '57c087c8-41a4-4fe9-a38a-ffb3398f8515', 'db8c3cf2-b523-4bdd-9e64-a08b6844c8a2', '1da27cc9-7a85-48c8-98f6-9095f74fad4c'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:08 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:37:08 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-32a67576-aeb2-478d-a271-f9ca0d1cd972-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-32a67576-aeb2-478d-a271-f9ca0d1cd972-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-quobyte-32a67576-aeb2-478d-a271-f9ca0d1cd972" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-32a67576-aeb2-478d-a271-f9ca0d1cd972" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0759e2f3-1cc1-4f80-a817-787075bb2ba7]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:09 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.677s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:09 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:09 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Deleted volume successfully. Jul 06 12:37:09 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972 Jul 06 12:37:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4894198c-6e7b-434f-8788-00b7c3a1d563 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-b1b8c471-abec-49ca-b8be-31bed0e48267-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:09 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:09 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972" returned: 0 in 0.818s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:10 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972 Jul 06 12:37:10 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:10 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-32a67576-aeb2-478d-a271-f9ca0d1cd972" returned: 0 in 0.648s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-32a67576-aeb2-478d-a271-f9ca0d1cd972" released by "delete_volume" :: held 1.524s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:10 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Created reservations ['0ddf87b7-4c89-4220-b74b-4a1ff55699b0', '8a89d790-0ee0-4ea3-b004-2dacaa473f64', 'ab8cbcde-2ee6-47b2-9912-3c205e5fa96f', 'cf0edf41-5c47-4389-b8ff-9999781b6812'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:10 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:37:10 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-cad3643e-f604-4657-9220-3448a1bba3ee-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-cad3643e-f604-4657-9220-3448a1bba3ee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-quobyte-cad3643e-f604-4657-9220-3448a1bba3ee" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-cad3643e-f604-4657-9220-3448a1bba3ee" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:11 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.658s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:11 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:11 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd22139c-5d25-42ee-8a7f-b2c61ba29fb4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:11 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Deleted volume successfully. Jul 06 12:37:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32a1a166-af5e-417b-bef1-51d76cfe3953 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-32a67576-aeb2-478d-a271-f9ca0d1cd972-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:11 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee Jul 06 12:37:11 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:12 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee" returned: 0 in 0.764s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:12 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee Jul 06 12:37:12 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:12 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cad3643e-f604-4657-9220-3448a1bba3ee" returned: 0 in 0.656s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-cad3643e-f604-4657-9220-3448a1bba3ee" released by "delete_volume" :: held 1.463s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:12 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Created reservations ['a61ce321-5823-4e0b-a32f-19396b4feac9', '4592c899-64f5-4493-8c50-7295f69853ef', 'c2fd2e06-acf5-4fac-814c-0457e9acc4ba', '702a575b-706b-441c-877a-deaafcb2a4c3'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:13 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:37:13 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-a5df7cfe-ecd7-48be-ae80-27aad270ca3a-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-a5df7cfe-ecd7-48be-ae80-27aad270ca3a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-quobyte-a5df7cfe-ecd7-48be-ae80-27aad270ca3a" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-a5df7cfe-ecd7-48be-ae80-27aad270ca3a" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[79db8f92-422d-404c-9b35-a96ca8331c86]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:13 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.725s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:13 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Deleted volume successfully. Jul 06 12:37:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-10bdfc06-a16b-48b2-85a0-f507a91cf361 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-cad3643e-f604-4657-9220-3448a1bba3ee-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:13 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a Jul 06 12:37:13 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:14 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a" returned: 0 in 0.763s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:14 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a Jul 06 12:37:14 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:15 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a5df7cfe-ecd7-48be-ae80-27aad270ca3a" returned: 0 in 0.673s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-a5df7cfe-ecd7-48be-ae80-27aad270ca3a" released by "delete_volume" :: held 1.478s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Created reservations ['85e52055-2b71-4e67-b1de-ff42cc7af338', '11324a89-576e-4f19-afe6-6d70030cffbb', 'ceff8824-0115-46e1-98a4-d89c5d63e96b', 'd0c9d7ce-27a1-41d8-97a1-edd863b17046'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:15 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:37:15 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-01925db6-fa41-45a3-a981-21dedbac4737-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-01925db6-fa41-45a3-a981-21dedbac4737-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-quobyte-3b9d8399-e7d0-4f0e-ad0a-69ff05962005" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-3b9d8399-e7d0-4f0e-ad0a-69ff05962005" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-quobyte-01925db6-fa41-45a3-a981-21dedbac4737" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-01925db6-fa41-45a3-a981-21dedbac4737" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Deleting offline snapshot 01925db6-fa41-45a3-a981-21dedbac4737 of volume 3b9d8399-e7d0-4f0e-ad0a-69ff05962005 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] snapshot_file for this snap is: volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f66c3ce-17c2-46bc-9cb7-18841ce7c147]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:15 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.728s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:15 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Deleted volume successfully. Jul 06 12:37:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b10dc825-200f-49a8-9fd2-374f5abce17b tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-a5df7cfe-ecd7-48be-ae80-27aad270ca3a-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:16 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 Jul 06 12:37:16 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:16 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737" returned: 0 in 0.811s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:16 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:37:16 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e37414-4fea-40c2-be40-5b8332a7c839]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:16 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 Jul 06 12:37:16 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:17 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005" returned: 0 in 0.825s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:17 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 Jul 06 12:37:17 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:18 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737" returned: 0 in 0.845s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:18 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737 Jul 06 12:37:18 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:19 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005.01925db6-fa41-45a3-a981-21dedbac4737" returned: 0 in 0.685s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-01925db6-fa41-45a3-a981-21dedbac4737" released by "_delete_snapshot" :: held 3.269s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-3b9d8399-e7d0-4f0e-ad0a-69ff05962005" released by "delete_snapshot" :: held 3.294s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:19 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Created reservations ['2885f1a2-9186-4e97-b714-6be2423295c5', '7bf69c1d-d2b9-406e-a899-22bd36fa31b1', '3488119c-3dcc-4045-9b00-57206bb79ff9', '236d3acb-0cea-4010-be47-9a4a9af6e40f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Delete snapshot completed successfully. Jul 06 12:37:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7f085c84-6423-4025-b19d-6c7ff8d0078f tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-01925db6-fa41-45a3-a981-21dedbac4737-delete_snapshot" released by "delete_snapshot" :: held 3.442s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-3b9d8399-e7d0-4f0e-ad0a-69ff05962005-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-3b9d8399-e7d0-4f0e-ad0a-69ff05962005-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "cinder-quobyte-3b9d8399-e7d0-4f0e-ad0a-69ff05962005" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-3b9d8399-e7d0-4f0e-ad0a-69ff05962005" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a263df-b94d-456d-aab5-ad763f478ebd]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:20 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 Jul 06 12:37:20 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:21 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005" returned: 0 in 0.840s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:21 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005 Jul 06 12:37:21 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:21 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b9d8399-e7d0-4f0e-ad0a-69ff05962005" returned: 0 in 0.666s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-quobyte-3b9d8399-e7d0-4f0e-ad0a-69ff05962005" released by "delete_volume" :: held 1.570s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Created reservations ['9c5f9166-b00c-48df-a64e-7b8d7027ee98', '7774106a-7bfa-4e8f-98f6-e86df125516f', 'f9f9258d-8c2c-4f69-b8ab-28c6fef6f4c1', 'c687ea90-aeb9-4d93-86a3-32c26a6c50a0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:21 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:37:21 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:22 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.718s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:22 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Deleted volume successfully. Jul 06 12:37:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9d2ae429-8017-45ee-8c0b-9eae55a911d3 tempest-CreateVolumesFromSnapshotTest-935359099 None] Lock "cinder-3b9d8399-e7d0-4f0e-ad0a-69ff05962005-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Flow 'volume_create_manager' (cbdbf6cf-91de-4d62-8e73-1816ea7b1ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e587e6-3d1a-4673-8910-baf0ba05524c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e587e6-3d1a-4673-8910-baf0ba05524c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027395677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b679f1-37dc-4c06-91b0-a54c5e6fcf38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f6d90f087b41b7a556d7af5f122692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:26Z,use_quota=True,user_id='7dc9dbc99d844210b0954bca9d8394b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a67aa6-2c86-405b-aded-a8f93feba8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a67aa6-2c86-405b-aded-a8f93feba8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3a38fc-156b-464c-9427-510120a9bd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3a38fc-156b-464c-9427-510120a9bd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b679f1-37dc-4c06-91b0-a54c5e6fcf38', 'volume_name': 'volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c84e7a-a410-43fa-9b82-ec27e604af71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c84e7a-a410-43fa-9b82-ec27e604af71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c745311f-d334-46f7-a7f7-d773cadd00bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Volume 12b679f1-37dc-4c06-91b0-a54c5e6fcf38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38', 'volume_size': 1} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027395677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b679f1-37dc-4c06-91b0-a54c5e6fcf38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f6d90f087b41b7a556d7af5f122692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:26Z,use_quota=True,user_id='7dc9dbc99d844210b0954bca9d8394b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Creating volume 12b679f1-37dc-4c06-91b0-a54c5e6fcf38 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:26 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:37:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:26 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38 1073741824 Jul 06 12:37:26 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:27 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38 1073741824" returned: 0 in 0.904s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:27 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38 Jul 06 12:37:27 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:28 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38" returned: 0 in 0.733s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c745311f-d334-46f7-a7f7-d773cadd00bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2705003-7837-4717-9d36-da11c04d09ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:28 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Volume volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38 (12b679f1-37dc-4c06-91b0-a54c5e6fcf38): created successfully Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2705003-7837-4717-9d36-da11c04d09ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Flow 'volume_create_manager' (cbdbf6cf-91de-4d62-8e73-1816ea7b1ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-87d730e2-6314-4c22-beab-1464b70e38e0 tempest-ProjectReaderTests-1116452899 None] Created volume successfully. Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Acquiring lock "cinder-12b679f1-37dc-4c06-91b0-a54c5e6fcf38-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Lock "cinder-12b679f1-37dc-4c06-91b0-a54c5e6fcf38-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Acquiring lock "cinder-quobyte-12b679f1-37dc-4c06-91b0-a54c5e6fcf38" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Lock "cinder-quobyte-12b679f1-37dc-4c06-91b0-a54c5e6fcf38" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f522d3-3c11-4627-bc34-8aecdd023597]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:29 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38 Jul 06 12:37:29 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:29 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38" returned: 0 in 0.829s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:29 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38 Jul 06 12:37:29 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:30 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-12b679f1-37dc-4c06-91b0-a54c5e6fcf38" returned: 0 in 0.701s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Lock "cinder-quobyte-12b679f1-37dc-4c06-91b0-a54c5e6fcf38" released by "delete_volume" :: held 1.597s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:30 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Created reservations ['5c3624a6-5b5f-4ed4-a347-767f962a6409', '7cff11b5-19c9-4f7c-923a-8559c791dce2', '4b787f07-f261-4477-90d6-6ba5a1a2c3f6', '7e3db09c-c17b-4d56-b4d1-fd18351dbfc2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:30 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:37:30 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:31 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.683s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Deleted volume successfully. Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c5da7908-d747-4ad7-b62f-80f341f6164b tempest-ProjectReaderTests-1116452899 None] Lock "cinder-12b679f1-37dc-4c06-91b0-a54c5e6fcf38-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Flow 'volume_create_manager' (9c568da0-a4a0-4423-8b62-56a045847eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe63afed-883f-432f-b962-35d331f2b770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe63afed-883f-432f-b962-35d331f2b770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-646252132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73feb6df-5b98-48e2-b0c4-5d813967b30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f6d90f087b41b7a556d7af5f122692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:32Z,use_quota=True,user_id='7dc9dbc99d844210b0954bca9d8394b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efec83af-7c3c-4cf3-9b74-8c82590d7d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efec83af-7c3c-4cf3-9b74-8c82590d7d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e107fb5-ce18-4cd2-8e66-efa28f5523b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e107fb5-ce18-4cd2-8e66-efa28f5523b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73feb6df-5b98-48e2-b0c4-5d813967b30c', 'volume_name': 'volume-73feb6df-5b98-48e2-b0c4-5d813967b30c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79322d3-0edb-4b19-9e38-f85af2a742d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79322d3-0edb-4b19-9e38-f85af2a742d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfda9b7c-9d13-4183-aa0e-6bce05a7d8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Volume 73feb6df-5b98-48e2-b0c4-5d813967b30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73feb6df-5b98-48e2-b0c4-5d813967b30c', 'volume_size': 1} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-646252132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73feb6df-5b98-48e2-b0c4-5d813967b30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f6d90f087b41b7a556d7af5f122692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:32Z,use_quota=True,user_id='7dc9dbc99d844210b0954bca9d8394b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Creating volume 73feb6df-5b98-48e2-b0c4-5d813967b30c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:31 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:37:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:31 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c 1073741824 Jul 06 12:37:31 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:32 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c 1073741824" returned: 0 in 0.897s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:32 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c Jul 06 12:37:32 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:37:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:32 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:37:32 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:33 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c" returned: 0 in 0.789s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfda9b7c-9d13-4183-aa0e-6bce05a7d8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73feb6df-5b98-48e2-b0c4-5d813967b30c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792538c7-5471-4b04-8228-014e3d2d9f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:33 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Volume volume-73feb6df-5b98-48e2-b0c4-5d813967b30c (73feb6df-5b98-48e2-b0c4-5d813967b30c): created successfully Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792538c7-5471-4b04-8228-014e3d2d9f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Flow 'volume_create_manager' (9c568da0-a4a0-4423-8b62-56a045847eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:33 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-42b0b60d-68e7-4687-9507-c8cd72706edc tempest-ProjectReaderTests-1116452899 None] Created volume successfully. Jul 06 12:37:33 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.796s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Acquiring lock "cinder-73feb6df-5b98-48e2-b0c4-5d813967b30c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Lock "cinder-73feb6df-5b98-48e2-b0c4-5d813967b30c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Acquiring lock "cinder-quobyte-73feb6df-5b98-48e2-b0c4-5d813967b30c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Lock "cinder-quobyte-73feb6df-5b98-48e2-b0c4-5d813967b30c" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e23c9f-2c05-4b66-a7a2-9239463b8132]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:33 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c Jul 06 12:37:33 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:34 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c" returned: 0 in 0.973s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:34 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c Jul 06 12:37:34 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:35 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-73feb6df-5b98-48e2-b0c4-5d813967b30c" returned: 0 in 0.693s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Lock "cinder-quobyte-73feb6df-5b98-48e2-b0c4-5d813967b30c" released by "delete_volume" :: held 1.713s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:35 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Created reservations ['94a53697-c691-4727-bf08-38eb15479684', '859edebc-efec-4086-a1b4-ab5cbdc8bb68', '3b967747-142e-430d-8076-192a65787886', '4d5f9533-7d76-49d7-a6f8-9a83b7c807bf'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:37:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:35 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:37:35 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:36 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.732s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:36 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:37:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Deleted volume successfully. Jul 06 12:37:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e4dbae9f-15c1-4d15-ade8-5a65e6b95abf tempest-ProjectReaderTests-1116452899 None] Lock "cinder-73feb6df-5b98-48e2-b0c4-5d813967b30c-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:37:45 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=87,cinder:SELECT=64,cinder:INSERT=28,cinder:DELETE=12 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:37:46 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=67,cinder:UPDATE=104,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (9ec18bf5-04e7-40da-ba5f-91ca64aa3011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edeba753-4860-4746-ba4a-777a1fac45a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edeba753-4860-4746-ba4a-777a1fac45a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-530355983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17af91c-d4bb-499b-9808-842714142b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:49Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad92eb52-9d1f-4ac0-9ab9-2276c8797869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad92eb52-9d1f-4ac0-9ab9-2276c8797869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e1a79a-5464-49da-8722-59d856a94cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e1a79a-5464-49da-8722-59d856a94cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17af91c-d4bb-499b-9808-842714142b29', 'volume_name': 'volume-b17af91c-d4bb-499b-9808-842714142b29', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0114d8bc-caaf-44bf-9c34-0a3eb6c909fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0114d8bc-caaf-44bf-9c34-0a3eb6c909fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522f2bfa-f886-449a-a63f-a5bf8910f2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:48 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume b17af91c-d4bb-499b-9808-842714142b29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17af91c-d4bb-499b-9808-842714142b29', 'volume_size': 1} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-530355983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17af91c-d4bb-499b-9808-842714142b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:49Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Creating volume b17af91c-d4bb-499b-9808-842714142b29 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:48 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:48 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29 1073741824 Jul 06 12:37:48 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (61bcfea6-1acd-4563-837e-a93ad8242653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233fee85-b35f-49f9-ae71-a244b1fd2879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233fee85-b35f-49f9-ae71-a244b1fd2879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026491664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2ac9db-fc58-42b5-9612-9da307701bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:49Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad6c684-3f4f-43ba-862b-d084c2358233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad6c684-3f4f-43ba-862b-d084c2358233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383c4998-c9a1-4d2c-b4d3-28dbda08451a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383c4998-c9a1-4d2c-b4d3-28dbda08451a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce2ac9db-fc58-42b5-9612-9da307701bbe', 'volume_name': 'volume-ce2ac9db-fc58-42b5-9612-9da307701bbe', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5d54a7-5b23-4f1b-9b81-d17f9bc9e154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5d54a7-5b23-4f1b-9b81-d17f9bc9e154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:49 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a896c396-4200-4758-958e-b222b44eca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:49 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume ce2ac9db-fc58-42b5-9612-9da307701bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce2ac9db-fc58-42b5-9612-9da307701bbe', 'volume_size': 1} Jul 06 12:37:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:49 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29 1073741824" returned: 0 in 0.977s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:49 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29 Jul 06 12:37:49 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:50 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29" returned: 0 in 0.733s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.586s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026491664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2ac9db-fc58-42b5-9612-9da307701bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:49Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Creating volume ce2ac9db-fc58-42b5-9612-9da307701bbe {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:50 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:50 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe 1073741824 Jul 06 12:37:50 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522f2bfa-f886-449a-a63f-a5bf8910f2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17af91c-d4bb-499b-9808-842714142b29', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8912c9-ec96-445a-bb79-2396851abb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:50 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume volume-b17af91c-d4bb-499b-9808-842714142b29 (b17af91c-d4bb-499b-9808-842714142b29): created successfully Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8912c9-ec96-445a-bb79-2396851abb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:50 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (9ec18bf5-04e7-40da-ba5f-91ca64aa3011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9ddd1222-97f9-4fed-860c-08f04dd93b1d tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created volume successfully. Jul 06 12:37:51 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe 1073741824" returned: 0 in 1.113s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:51 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe Jul 06 12:37:51 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (3fdf6895-d532-406a-aa4c-cf995ab08a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2f5a47-bce9-428f-88e3-201ee06890cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2f5a47-bce9-428f-88e3-201ee06890cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-596546552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc75c6d-5fcc-4dd7-a765-165d0f36e728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:53Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052d61f6-f2ba-4677-ab70-d9db992103fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052d61f6-f2ba-4677-ab70-d9db992103fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60e5814-00ca-489c-b0af-a2cabcf0c111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60e5814-00ca-489c-b0af-a2cabcf0c111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fc75c6d-5fcc-4dd7-a765-165d0f36e728', 'volume_name': 'volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5e2959-486e-4cd3-887b-af578920d205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5e2959-486e-4cd3-887b-af578920d205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc9d636-811d-42a6-8b2f-c67506700da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:52 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume 6fc75c6d-5fcc-4dd7-a765-165d0f36e728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728', 'volume_size': 1} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:52 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe" returned: 0 in 1.141s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.173s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-596546552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fc75c6d-5fcc-4dd7-a765-165d0f36e728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:53Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Creating volume 6fc75c6d-5fcc-4dd7-a765-165d0f36e728 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:53 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:53 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728 1073741824 Jul 06 12:37:53 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a896c396-4200-4758-958e-b222b44eca0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce2ac9db-fc58-42b5-9612-9da307701bbe', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea3dc6f-24e8-4fc6-ba1c-0eecf311d9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume volume-ce2ac9db-fc58-42b5-9612-9da307701bbe (ce2ac9db-fc58-42b5-9612-9da307701bbe): created successfully Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea3dc6f-24e8-4fc6-ba1c-0eecf311d9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (61bcfea6-1acd-4563-837e-a93ad8242653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d01fcdc5-e273-4a36-a428-9fbc89762aba tempest-CreateVolumesFromSnapshotTest-300238410 None] Created volume successfully. Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (8c09cc40-de73-464e-80a2-9bffdeccf6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b699b01-37c3-445e-b896-640b1d978568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b699b01-37c3-445e-b896-640b1d978568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938174370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018417f9-0a3c-466a-9ebc-2e7282700ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:53Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fe9cc9-57ee-434b-8630-7338c6df925a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fe9cc9-57ee-434b-8630-7338c6df925a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4aa137-9319-4127-a121-460262e92503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4aa137-9319-4127-a121-460262e92503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018417f9-0a3c-466a-9ebc-2e7282700ee4', 'volume_name': 'volume-018417f9-0a3c-466a-9ebc-2e7282700ee4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749046ec-b43d-4892-8705-9b20235d7cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749046ec-b43d-4892-8705-9b20235d7cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9f0627-d4e8-4d1b-aa7a-c09d16940232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:53 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume 018417f9-0a3c-466a-9ebc-2e7282700ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018417f9-0a3c-466a-9ebc-2e7282700ee4', 'volume_size': 1} Jul 06 12:37:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (31d2b6de-b9ba-4869-a162-6d495b10ce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61eee93c-0b2f-40e1-821a-3926fbe75b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728 1073741824" returned: 0 in 1.361s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61eee93c-0b2f-40e1-821a-3926fbe75b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1132006244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00271919-1145-464d-92ee-6d298cf775b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:54Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d568356-1cea-4429-8ac8-705adea852f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d568356-1cea-4429-8ac8-705adea852f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cc1e80-9e34-4e4c-91ba-62b542fd8827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cc1e80-9e34-4e4c-91ba-62b542fd8827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00271919-1145-464d-92ee-6d298cf775b0', 'volume_name': 'volume-00271919-1145-464d-92ee-6d298cf775b0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75160744-8536-45d3-89d4-cb22b6449d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75160744-8536-45d3-89d4-cb22b6449d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3281e1b5-91c9-4a94-85eb-85c9273ceaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume 00271919-1145-464d-92ee-6d298cf775b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00271919-1145-464d-92ee-6d298cf775b0', 'volume_size': 1} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:54 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728 Jul 06 12:37:54 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Flow 'volume_create_manager' (1e460b54-f0c0-4c8c-a23c-b0d14b32d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70df2660-ebaf-402f-aacf-79ce48f9d815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70df2660-ebaf-402f-aacf-79ce48f9d815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68bd3ea-57ac-4ad0-ad40-1bba3425942c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb604300d54f474d94ee63fa2c11b297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:54Z,use_quota=True,user_id='253fb08014574d30a58d9e6c08519987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(417664dd-c63f-47a0-b83d-a9caaca6cd77),volume_type_id=417664dd-c63f-47a0-b83d-a9caaca6cd77)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afc4f8c-59f9-4975-8e92-9fd950b57285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afc4f8c-59f9-4975-8e92-9fd950b57285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf0f816-dfed-4345-a2db-51b27336f33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (d7f90ac2-6768-4132-be96-fcf1aeb9b6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4546313-5f71-47e3-975e-2a2c224a85a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4546313-5f71-47e3-975e-2a2c224a85a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-758773996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:55Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90b4121-afee-462c-af8e-3d408ece81a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90b4121-afee-462c-af8e-3d408ece81a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1a332c-18bc-4b31-b007-abbec1dff3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1a332c-18bc-4b31-b007-abbec1dff3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2', 'volume_name': 'volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b719504-503b-4d54-a20c-1a035586e243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b719504-503b-4d54-a20c-1a035586e243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee5476c-0dfc-428b-a063-920910ca809d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:54 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume 0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2', 'volume_size': 1} Jul 06 12:37:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (a171ad58-2d4d-4e30-895a-9764ad5b95db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d01a5a2-17d5-47b9-9394-dfd0eae9afa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d01a5a2-17d5-47b9-9394-dfd0eae9afa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-231864166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79402cad-8533-4b19-bcba-c57319ff71f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:55Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996977b8-6178-41be-9bd1-b82df1f0b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996977b8-6178-41be-9bd1-b82df1f0b85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75e154f-d61b-463f-8480-ab298d83e253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75e154f-d61b-463f-8480-ab298d83e253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79402cad-8533-4b19-bcba-c57319ff71f7', 'volume_name': 'volume-79402cad-8533-4b19-bcba-c57319ff71f7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31e9b5c-fa69-4361-8ffc-c431cf23a69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31e9b5c-fa69-4361-8ffc-c431cf23a69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c804507-a3a6-4fd8-a868-fa8f747c8567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume 79402cad-8533-4b19-bcba-c57319ff71f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79402cad-8533-4b19-bcba-c57319ff71f7', 'volume_size': 1} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf0f816-dfed-4345-a2db-51b27336f33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f68bd3ea-57ac-4ad0-ad40-1bba3425942c', 'volume_name': 'volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c', 'volume_size': 1, 'image_id': 'b41d295f-370d-4333-8a9c-513d0d5abb7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b41d295f-370d-4333-8a9c-513d0d5abb7a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b213b4f4a7fd8e08e440a20f0eaac0d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb604300d54f474d94ee63fa2c11b297', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0506b9fbe87d03bf6d0fd00718b6ed81372aea06da6e37e382602aa0ef8dd0f720acd9552b9d39383a7cb8bc1fd1a82004b39f292c930dff641627bfef6ea8d7', 'id': 'b41d295f-370d-4333-8a9c-513d0d5abb7a', 'created_at': datetime.datetime(2026, 7, 6, 10, 37, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 37, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b41d295f-370d-4333-8a9c-513d0d5abb7a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d34ef1b-ad48-4d50-979b-e34e11ddce6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d34ef1b-ad48-4d50-979b-e34e11ddce6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf8202d-7d26-4101-b3e5-5af653c95489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Volume f68bd3ea-57ac-4ad0-ad40-1bba3425942c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c', 'volume_size': 1, 'image_id': 'b41d295f-370d-4333-8a9c-513d0d5abb7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b41d295f-370d-4333-8a9c-513d0d5abb7a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b213b4f4a7fd8e08e440a20f0eaac0d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb604300d54f474d94ee63fa2c11b297', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0506b9fbe87d03bf6d0fd00718b6ed81372aea06da6e37e382602aa0ef8dd0f720acd9552b9d39383a7cb8bc1fd1a82004b39f292c930dff641627bfef6ea8d7', 'id': 'b41d295f-370d-4333-8a9c-513d0d5abb7a', 'created_at': datetime.datetime(2026, 7, 6, 10, 37, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 37, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b41d295f-370d-4333-8a9c-513d0d5abb7a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Trying to clone f68bd3ea-57ac-4ad0-ad40-1bba3425942c from image b41d295f-370d-4333-8a9c-513d0d5abb7a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b41d295f-370d-4333-8a9c-513d0d5abb7a', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:37:55 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728" returned: 0 in 0.936s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] <== create_volume: return (2441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.446s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.941s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-938174370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018417f9-0a3c-466a-9ebc-2e7282700ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:53Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Creating volume 018417f9-0a3c-466a-9ebc-2e7282700ee4 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:55 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc9d636-811d-42a6-8b2f-c67506700da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cf79a1-be33-4f63-bbd6-e2e92336288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:55 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4 1073741824 Jul 06 12:37:55 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:37:55 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:37:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728 (6fc75c6d-5fcc-4dd7-a765-165d0f36e728): created successfully Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cf79a1-be33-4f63-bbd6-e2e92336288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (3fdf6895-d532-406a-aa4c-cf995ab08a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:55 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-75ce56a0-328d-4ccb-b781-30c5bed28464 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created volume successfully. Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f97fb7-58ce-4034-a8f6-3c7eb6f212f8]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:55 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD Jul 06 12:37:55 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:56 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4 1073741824" returned: 0 in 1.018s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:56 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD" returned: 0 in 0.891s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:56 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4 Jul 06 12:37:56 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:56 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD Jul 06 12:37:56 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:57 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4" returned: 0 in 0.710s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.807s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1132006244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00271919-1145-464d-92ee-6d298cf775b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:54Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Creating volume 00271919-1145-464d-92ee-6d298cf775b0 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:37:57 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9f0627-d4e8-4d1b-aa7a-c09d16940232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018417f9-0a3c-466a-9ebc-2e7282700ee4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:57 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0 1073741824 Jul 06 12:37:57 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96c5b79-aac7-4407-83e3-5d5ad40dce19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume volume-018417f9-0a3c-466a-9ebc-2e7282700ee4 (018417f9-0a3c-466a-9ebc-2e7282700ee4): created successfully Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96c5b79-aac7-4407-83e3-5d5ad40dce19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:57 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (8c09cc40-de73-464e-80a2-9bffdeccf6ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD" returned: 1 in 0.874s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Temporary image b41d295f-370d-4333-8a9c-513d0d5abb7a is fetched for user 253fb08014574d30a58d9e6c08519987. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:37:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-507fc56d-8e42-4d68-87bd-627a71ae92aa tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created volume successfully. Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[610f797e-a5b5-456a-a6a1-985757c72185]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:57 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD Jul 06 12:37:57 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:58 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:58 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD" returned: 0 in 0.837s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0 1073741824" returned: 0 in 1.029s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:58 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0 Jul 06 12:37:58 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:58 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD Jul 06 12:37:58 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:37:59 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0" returned: 0 in 0.696s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.503s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3281e1b5-91c9-4a94-85eb-85c9273ceaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00271919-1145-464d-92ee-6d298cf775b0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288e792c-4e73-4157-afa6-21091e717815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] Creating offline snapshot c734c18c-016d-4ab8-b351-435501b39826 of volume ce2ac9db-fc58-42b5-9612-9da307701bbe {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:37:59 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD" returned: 1 in 0.799s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:37:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume volume-00271919-1145-464d-92ee-6d298cf775b0 (00271919-1145-464d-92ee-6d298cf775b0): created successfully Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288e792c-4e73-4157-afa6-21091e717815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (31d2b6de-b9ba-4869-a162-6d495b10ce5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd3bdb2-bb00-496d-98a0-20c1a3800434]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:37:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:37:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4b95061e-1a26-4a02-9ae3-b6d4fac67058 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created volume successfully. Jul 06 12:37:59 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe Jul 06 12:37:59 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:00 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe" returned: 0 in 0.907s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:00 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 1G Jul 06 12:38:00 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:00 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 1G" returned: 0 in 0.860s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2ac9db-fc58-42b5-9612-9da307701bbe -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:00 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2ac9db-fc58-42b5-9612-9da307701bbe -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 Jul 06 12:38:00 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:01 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2ac9db-fc58-42b5-9612-9da307701bbe -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826" returned: 0 in 0.788s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:01 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 is being set with open permissions: ugo+rw Jul 06 12:38:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:01 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 Jul 06 12:38:01 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:02 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826" returned: 0 in 0.723s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:02 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.info Jul 06 12:38:02 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:03 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.info" returned: 0 in 0.857s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:03 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.info is being set with open permissions: ugo+rw Jul 06 12:38:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:03 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.info Jul 06 12:38:03 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:04 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.info" returned: 0 in 0.787s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.084s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.343s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-758773996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:55Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Creating volume 0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:04 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:04 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2 1073741824 Jul 06 12:38:04 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e2f771f6-3fea-4513-bb1f-e13ea6aea792 tempest-CreateVolumesFromSnapshotTest-300238410 None] Create snapshot completed successfully Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (af5e3095-cae4-4aac-bf3f-b635d065096f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b08e06-a179-4585-9906-e87e827aa414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b08e06-a179-4585-9906-e87e827aa414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1409871833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1245ceb1-62df-4911-95f6-df9d91e56c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:05Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:05 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a420419-afc8-4689-95ba-bf1c2fe4e99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a420419-afc8-4689-95ba-bf1c2fe4e99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef53355-f225-40c6-9217-d3688c7d6248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef53355-f225-40c6-9217-d3688c7d6248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1245ceb1-62df-4911-95f6-df9d91e56c4b', 'volume_name': 'volume-1245ceb1-62df-4911-95f6-df9d91e56c4b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa2c6ae-6454-431c-bbd2-ea518de5b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa2c6ae-6454-431c-bbd2-ea518de5b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873220b3-b453-4a9e-8b40-1df6fcdf66b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume 1245ceb1-62df-4911-95f6-df9d91e56c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1245ceb1-62df-4911-95f6-df9d91e56c4b', 'volume_size': 1} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2 1073741824" returned: 0 in 1.247s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:05 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2 Jul 06 12:38:05 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (31474e6d-0214-403d-bfb6-b11755efb599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afe6537-34d1-4a4e-8aaa-c3398e05fe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afe6537-34d1-4a4e-8aaa-c3398e05fe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1795415128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7945d40b-5c0a-4b0a-9011-bd54c42317d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:06Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ade631f-d3ca-42f4-a578-e77ae3128e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ade631f-d3ca-42f4-a578-e77ae3128e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c89289-60fc-49f7-986b-59bb1186619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c89289-60fc-49f7-986b-59bb1186619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7945d40b-5c0a-4b0a-9011-bd54c42317d2', 'volume_name': 'volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ef90f3-3882-43fe-a85a-d6913ef2cfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ef90f3-3882-43fe-a85a-d6913ef2cfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1bbc09b-4fc5-4367-98c6-f4ea5dad2b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume 7945d40b-5c0a-4b0a-9011-bd54c42317d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2', 'volume_size': 1} Jul 06 12:38:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:06 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (77259701-8840-4e7a-a78a-6dd5a010a5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8e6d0c-99dc-4c3f-9cca-04ed0b2f1ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2" returned: 0 in 0.970s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.285s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.087s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-231864166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79402cad-8533-4b19-bcba-c57319ff71f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='250299a11cb9403f8d93182fede0cc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:55Z,use_quota=True,user_id='0a4cf32e42094e4bae0e87c78f1579be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Creating volume 79402cad-8533-4b19-bcba-c57319ff71f7 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:06 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8e6d0c-99dc-4c3f-9cca-04ed0b2f1ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905017625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe74f7e0-df71-4721-a324-83f018c9d02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:06Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:06 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7 1073741824 Jul 06 12:38:06 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00407da-8fe0-43ae-846c-fbaf537a453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00407da-8fe0-43ae-846c-fbaf537a453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f451cc1e-b408-482c-9e1f-9508e08b6a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f451cc1e-b408-482c-9e1f-9508e08b6a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe74f7e0-df71-4721-a324-83f018c9d02a', 'volume_name': 'volume-fe74f7e0-df71-4721-a324-83f018c9d02a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b139e1-4764-43ce-b59d-463c8c3a7af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b139e1-4764-43ce-b59d-463c8c3a7af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bd9ab6-9419-4104-abf2-708c9c3bb568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume fe74f7e0-df71-4721-a324-83f018c9d02a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe74f7e0-df71-4721-a324-83f018c9d02a', 'volume_size': 1} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee5476c-0dfc-428b-a063-920910ca809d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e09d8b-3c9e-4821-8a98-a79903ad833b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2 (0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2): created successfully Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e09d8b-3c9e-4821-8a98-a79903ad833b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (d7f90ac2-6768-4132-be96-fcf1aeb9b6a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:06 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-88381bce-49ca-410c-87bc-4fc53c2d4a33 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created volume successfully. Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (54826e0d-8901-48ac-ade6-592bb6e0774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7a783c-671e-4f37-bdb8-7a098d3a77a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7a783c-671e-4f37-bdb8-7a098d3a77a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230647775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e061ba9b-5d60-42b7-bce2-4adecffc0983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:07Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7ea8ec-8b20-4cbe-a898-44933570288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7ea8ec-8b20-4cbe-a898-44933570288c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbce80b-3fd7-423f-ab2b-0fb30ed5154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbce80b-3fd7-423f-ab2b-0fb30ed5154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e061ba9b-5d60-42b7-bce2-4adecffc0983', 'volume_name': 'volume-e061ba9b-5d60-42b7-bce2-4adecffc0983', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea944d84-d393-4fd0-8bdd-d9314ead932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea944d84-d393-4fd0-8bdd-d9314ead932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19098c3-c766-4211-9041-628cbbcb2a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume e061ba9b-5d60-42b7-bce2-4adecffc0983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e061ba9b-5d60-42b7-bce2-4adecffc0983', 'volume_size': 1} Jul 06 12:38:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (a184e3cb-0782-4dcf-9992-9bab107eee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026a4a2d-c4b8-4c73-99bd-4233198ca975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026a4a2d-c4b8-4c73-99bd-4233198ca975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1235274925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8480b52b-a222-4121-8cdb-552142827af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:07Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe2d872-1c7d-453a-b99f-95c86e527ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe2d872-1c7d-453a-b99f-95c86e527ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1a45b9-05d4-43b5-ba14-620f0763bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1a45b9-05d4-43b5-ba14-620f0763bf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8480b52b-a222-4121-8cdb-552142827af4', 'volume_name': 'volume-8480b52b-a222-4121-8cdb-552142827af4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3016a1c4-993d-4047-bcea-e789d22e2e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3016a1c4-993d-4047-bcea-e789d22e2e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac406fd2-042e-446b-831a-945fc4b3bd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume 8480b52b-a222-4121-8cdb-552142827af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8480b52b-a222-4121-8cdb-552142827af4', 'volume_size': 1} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:07 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7 1073741824" returned: 0 in 1.252s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:07 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7 Jul 06 12:38:07 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:08 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7" returned: 0 in 0.706s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.356s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68bd3ea-57ac-4ad0-ad40-1bba3425942c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb604300d54f474d94ee63fa2c11b297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:37:54Z,use_quota=True,user_id='253fb08014574d30a58d9e6c08519987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(417664dd-c63f-47a0-b83d-a9caaca6cd77),volume_type_id=417664dd-c63f-47a0-b83d-a9caaca6cd77)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Creating volume f68bd3ea-57ac-4ad0-ad40-1bba3425942c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:08 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c804507-a3a6-4fd8-a868-fa8f747c8567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79402cad-8533-4b19-bcba-c57319ff71f7', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa7a3f3-bf49-480d-ba55-255ecda733b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:08 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c 1073741824 Jul 06 12:38:08 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Volume volume-79402cad-8533-4b19-bcba-c57319ff71f7 (79402cad-8533-4b19-bcba-c57319ff71f7): created successfully Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa7a3f3-bf49-480d-ba55-255ecda733b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Flow 'volume_create_manager' (a171ad58-2d4d-4e30-895a-9764ad5b95db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5df4a3d7-afce-428e-82d9-5aa7fe5b6c01 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created volume successfully. Jul 06 12:38:09 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c 1073741824" returned: 0 in 0.925s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:09 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c Jul 06 12:38:09 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-79402cad-8533-4b19-bcba-c57319ff71f7-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-79402cad-8533-4b19-bcba-c57319ff71f7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-quobyte-79402cad-8533-4b19-bcba-c57319ff71f7" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-79402cad-8533-4b19-bcba-c57319ff71f7" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1eceb2-c414-4917-9326-7f83e97aa902]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:09 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7 Jul 06 12:38:09 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:10 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c" returned: 0 in 0.817s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.854s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1409871833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1245ceb1-62df-4911-95f6-df9d91e56c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:05Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Creating volume 1245ceb1-62df-4911-95f6-df9d91e56c4b {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:10 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:10 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b 1073741824 Jul 06 12:38:10 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Attempting download of b41d295f-370d-4333-8a9c-513d0d5abb7a ((None, [{'url': 'file:///opt/stack/data/glance/images/b41d295f-370d-4333-8a9c-513d0d5abb7a', 'metadata': {}}])) to volume f68bd3ea-57ac-4ad0-ad40-1bba3425942c. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e060c03-21e7-4cf1-b557-c58029603a7a]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b41d295f-370d-4333-8a9c-513d0d5abb7a_ar1nlaw9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:10 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b41d295f-370d-4333-8a9c-513d0d5abb7a_ar1nlaw9 Jul 06 12:38:10 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:10 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7" returned: 0 in 0.977s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:10 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7 Jul 06 12:38:10 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:11 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b41d295f-370d-4333-8a9c-513d0d5abb7a_ar1nlaw9" returned: 0 in 0.947s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b41d295f-370d-4333-8a9c-513d0d5abb7a_ar1nlaw9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:11 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b41d295f-370d-4333-8a9c-513d0d5abb7a_ar1nlaw9 Jul 06 12:38:11 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:11 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-79402cad-8533-4b19-bcba-c57319ff71f7" returned: 0 in 0.856s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:11 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b 1073741824" returned: 0 in 1.365s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-79402cad-8533-4b19-bcba-c57319ff71f7" released by "delete_volume" :: held 1.900s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:11 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b Jul 06 12:38:11 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created reservations ['3acaf7a2-9616-43f7-87c8-5f3df8ad287c', '517c4bbb-1618-4b76-a462-c83893888099', '4d585a88-b197-425a-a059-58a3da4eb418', '9f5aac57-e9fc-4220-82e9-67879fbcd065'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:11 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:11 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-quobyte-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e3676c-9e03-4c03-88ce-de7817e675f5]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:12 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2 Jul 06 12:38:12 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:12 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b41d295f-370d-4333-8a9c-513d0d5abb7a_ar1nlaw9" returned: 1 in 1.204s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b41d295f-370d-4333-8a9c-513d0d5abb7a_ar1nlaw9' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7feedb-5adb-49dc-aa0a-f094267b24ad]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:12 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b" returned: 0 in 0.953s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] <== create_volume: return (2405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.414s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.708s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1795415128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7945d40b-5c0a-4b0a-9011-bd54c42317d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:06Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Creating volume 7945d40b-5c0a-4b0a-9011-bd54c42317d2 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:12 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:12 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2 1073741824 Jul 06 12:38:12 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873220b3-b453-4a9e-8b40-1df6fcdf66b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1245ceb1-62df-4911-95f6-df9d91e56c4b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:12 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6bd689-2df0-4c97-a8b1-3903d124b6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:12 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume volume-1245ceb1-62df-4911-95f6-df9d91e56c4b (1245ceb1-62df-4911-95f6-df9d91e56c4b): created successfully Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6bd689-2df0-4c97-a8b1-3903d124b6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (af5e3095-cae4-4aac-bf3f-b635d065096f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b2fb953a-a63b-4055-8ab8-d39110a055e8 tempest-CreateVolumesFromSnapshotTest-300238410 None] Created volume successfully. Jul 06 12:38:13 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.193s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:13 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:13 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Deleted volume successfully. Jul 06 12:38:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2371678b-faf6-402c-9ca3-092c97bd38a9 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-79402cad-8533-4b19-bcba-c57319ff71f7-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:13 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2" returned: 0 in 1.223s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:13 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2 Jul 06 12:38:13 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:13 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD" returned: 0 in 1.195s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:13 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD Jul 06 12:38:13 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:13 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2 1073741824" returned: 0 in 1.290s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:14 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2 Jul 06 12:38:14 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:14 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2" returned: 0 in 1.027s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2" released by "delete_volume" :: held 2.341s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created reservations ['9e77820e-c380-4979-87c0-23328393878c', '5d36cb88-b05c-4b57-afa3-e36405a86260', '10f57406-cb2b-43cb-8952-27b8e8058f79', '809dd12f-fc50-4e4c-8f59-1ca8e8a7f76a'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:14 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:14 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:14 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD" returned: 1 in 1.142s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] b41d295f-370d-4333-8a9c-513d0d5abb7a was raw, converting to raw {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:38:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:14 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c Jul 06 12:38:14 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:14 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2" returned: 0 in 0.952s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] <== create_volume: return (2311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.316s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.473s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1905017625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe74f7e0-df71-4721-a324-83f018c9d02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:06Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Creating volume fe74f7e0-df71-4721-a324-83f018c9d02a {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:15 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1bbc09b-4fc5-4367-98c6-f4ea5dad2b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6867b0ca-653d-4da0-aaad-72a5e6930ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:15 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2 (7945d40b-5c0a-4b0a-9011-bd54c42317d2): created successfully Jul 06 12:38:15 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a 1073741824 Jul 06 12:38:15 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6867b0ca-653d-4da0-aaad-72a5e6930ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (31474e6d-0214-403d-bfb6-b11755efb599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-16072f64-7905-45bf-8936-39742050ae34 tempest-CreateVolumesFromSnapshotTest-300238410 None] Created volume successfully. Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-00271919-1145-464d-92ee-6d298cf775b0-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-00271919-1145-464d-92ee-6d298cf775b0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-quobyte-00271919-1145-464d-92ee-6d298cf775b0" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-00271919-1145-464d-92ee-6d298cf775b0" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adb5f5c-c7cb-4874-8593-a4027143001b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:15 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.949s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Deleted volume successfully. Jul 06 12:38:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2cdf4960-f6e5-48b5-b0c7-c0d9db489e7f tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-0f018efd-b2ff-4ea1-a5fb-7bd6ce8841d2-delete_volume" released by "delete_volume" :: held 3.740s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:15 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0 Jul 06 12:38:15 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:16 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c" returned: 0 in 1.116s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:16 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b41d295f-370d-4333-8a9c-513d0d5abb7a_oldc16qbdevstack@QuobyteHD, size 0.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:38:16 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:38:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:16 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c 1G Jul 06 12:38:16 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:16 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a 1073741824" returned: 0 in 1.274s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:16 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a Jul 06 12:38:16 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:16 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0" returned: 0 in 1.067s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:16 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0 Jul 06 12:38:16 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:16 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c 1G" returned: 0 in 0.863s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:16 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5732564-85c4-449a-b6bd-db30f902da50]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:17 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c Jul 06 12:38:17 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:17 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a" returned: 0 in 0.860s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.259s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230647775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e061ba9b-5d60-42b7-bce2-4adecffc0983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:07Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Creating volume e061ba9b-5d60-42b7-bce2-4adecffc0983 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:17 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:17 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983 1073741824 Jul 06 12:38:17 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bd9ab6-9419-4104-abf2-708c9c3bb568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe74f7e0-df71-4721-a324-83f018c9d02a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2692b6c6-7e53-4d3c-b713-fa922af4c667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:17 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume volume-fe74f7e0-df71-4721-a324-83f018c9d02a (fe74f7e0-df71-4721-a324-83f018c9d02a): created successfully Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2692b6c6-7e53-4d3c-b713-fa922af4c667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (77259701-8840-4e7a-a78a-6dd5a010a5a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ac36d4d4-345b-4954-bf67-f63f00234e54 tempest-CreateVolumesFromSnapshotTest-300238410 None] Created volume successfully. Jul 06 12:38:17 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-00271919-1145-464d-92ee-6d298cf775b0" returned: 0 in 0.831s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-00271919-1145-464d-92ee-6d298cf775b0" released by "delete_volume" :: held 1.975s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created reservations ['c9044b5c-1445-4e7b-a7c6-e2146bb2b35b', '2b4511c9-70ca-4255-a5d6-3a18f42eb95d', '994bbef2-585e-4da6-8d8e-e2ea80869ae3', '552943f2-55dc-44df-81c4-a39dbb344917'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:17 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:17 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:17 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c" returned: 0 in 0.980s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-018417f9-0a3c-466a-9ebc-2e7282700ee4-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-018417f9-0a3c-466a-9ebc-2e7282700ee4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:18 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c Jul 06 12:38:18 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-quobyte-018417f9-0a3c-466a-9ebc-2e7282700ee4" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-018417f9-0a3c-466a-9ebc-2e7282700ee4" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f28e86-9ad1-46c6-a9f9-1f5bebdaa529]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:18 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4 Jul 06 12:38:18 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:18 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.907s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:18 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Deleted volume successfully. Jul 06 12:38:18 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983 1073741824" returned: 0 in 1.572s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-59341cd1-f491-46f9-9df4-c82a801106ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-00271919-1145-464d-92ee-6d298cf775b0-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:18 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983 Jul 06 12:38:18 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:19 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c" returned: 1 in 1.227s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Downloaded image b41d295f-370d-4333-8a9c-513d0d5abb7a ((None, [{'url': 'file:///opt/stack/data/glance/images/b41d295f-370d-4333-8a9c-513d0d5abb7a', 'metadata': {}}])) to volume f68bd3ea-57ac-4ad0-ad40-1bba3425942c successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Temporary image b41d295f-370d-4333-8a9c-513d0d5abb7a for user 253fb08014574d30a58d9e6c08519987 is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Marking volume f68bd3ea-57ac-4ad0-ad40-1bba3425942c as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Copying metadata from image b41d295f-370d-4333-8a9c-513d0d5abb7a to f68bd3ea-57ac-4ad0-ad40-1bba3425942c. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Creating volume glance metadata for volume f68bd3ea-57ac-4ad0-ad40-1bba3425942c backed by image b41d295f-370d-4333-8a9c-513d0d5abb7a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b41d295f-370d-4333-8a9c-513d0d5abb7a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b213b4f4a7fd8e08e440a20f0eaac0d6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf8202d-7d26-4101-b3e5-5af653c95489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c', 'volume_size': 1, 'image_id': 'b41d295f-370d-4333-8a9c-513d0d5abb7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b41d295f-370d-4333-8a9c-513d0d5abb7a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b213b4f4a7fd8e08e440a20f0eaac0d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bb604300d54f474d94ee63fa2c11b297', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0506b9fbe87d03bf6d0fd00718b6ed81372aea06da6e37e382602aa0ef8dd0f720acd9552b9d39383a7cb8bc1fd1a82004b39f292c930dff641627bfef6ea8d7', 'id': 'b41d295f-370d-4333-8a9c-513d0d5abb7a', 'created_at': datetime.datetime(2026, 7, 6, 10, 37, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 37, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b41d295f-370d-4333-8a9c-513d0d5abb7a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2aa599-dd6b-4a9f-98db-b21e80ba0469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:19 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Volume volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c (f68bd3ea-57ac-4ad0-ad40-1bba3425942c): created successfully Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2aa599-dd6b-4a9f-98db-b21e80ba0469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Flow 'volume_create_manager' (1e460b54-f0c0-4c8c-a23c-b0d14b32d09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-05d9b7c9-1855-4892-899e-c8c34c393542 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Created volume successfully. Jul 06 12:38:19 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4" returned: 0 in 1.291s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:19 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4 Jul 06 12:38:19 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:19 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983" returned: 0 in 0.829s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] <== create_volume: return (2482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.489s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.263s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1235274925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8480b52b-a222-4121-8cdb-552142827af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8e0a2159d5740dbbd447ee9b34a1b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:07Z,use_quota=True,user_id='38454a88e1654cc3bc8069395ad0b5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Creating volume 8480b52b-a222-4121-8cdb-552142827af4 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:19 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:19 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4 1073741824 Jul 06 12:38:19 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19098c3-c766-4211-9041-628cbbcb2a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e061ba9b-5d60-42b7-bce2-4adecffc0983', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16908a4-30b2-4f0b-a32b-15e5bff16d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:19 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume volume-e061ba9b-5d60-42b7-bce2-4adecffc0983 (e061ba9b-5d60-42b7-bce2-4adecffc0983): created successfully Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16908a4-30b2-4f0b-a32b-15e5bff16d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:19 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (54826e0d-8901-48ac-ade6-592bb6e0774a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:19 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-829860e0-a8ad-43b0-9a67-f0cf0a8fba3c tempest-CreateVolumesFromSnapshotTest-300238410 None] Created volume successfully. Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Acquiring lock "cinder-f68bd3ea-57ac-4ad0-ad40-1bba3425942c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Lock "cinder-f68bd3ea-57ac-4ad0-ad40-1bba3425942c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Acquiring lock "cinder-quobyte-f68bd3ea-57ac-4ad0-ad40-1bba3425942c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Lock "cinder-quobyte-f68bd3ea-57ac-4ad0-ad40-1bba3425942c" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5076b4dc-5367-40d3-903b-ef5d76eaa99a]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:20 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-018417f9-0a3c-466a-9ebc-2e7282700ee4" returned: 0 in 0.804s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-018417f9-0a3c-466a-9ebc-2e7282700ee4" released by "delete_volume" :: held 2.178s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:20 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c Jul 06 12:38:20 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created reservations ['fc1870ab-1559-431c-a3d1-fc9bd28e41e8', 'f41fa02c-4bd9-4728-8a1b-20628b8d51d6', '0f6b232a-66d2-491e-ab7f-47f0d67ea95f', '6520812e-38b0-41cc-a6cf-06753b108fea'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:20 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:20 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:20 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4 1073741824" returned: 0 in 1.213s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:21 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4 Jul 06 12:38:21 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:21 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c" returned: 0 in 1.127s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:21 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c Jul 06 12:38:21 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-6fc75c6d-5fcc-4dd7-a765-165d0f36e728-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-6fc75c6d-5fcc-4dd7-a765-165d0f36e728-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-quobyte-6fc75c6d-5fcc-4dd7-a765-165d0f36e728" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-6fc75c6d-5fcc-4dd7-a765-165d0f36e728" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50fdc38-3a02-4f21-9d79-ec3b33f322d5]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:21 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.300s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:21 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728 Jul 06 12:38:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Deleted volume successfully. Jul 06 12:38:21 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:21 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4" returned: 0 in 1.002s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-284aa9b3-c307-4505-b687-80d40b5a80ce tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-018417f9-0a3c-466a-9ebc-2e7282700ee4-delete_volume" released by "delete_volume" :: held 3.947s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac406fd2-042e-446b-831a-945fc4b3bd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8480b52b-a222-4121-8cdb-552142827af4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598703ac-9fe4-4cd3-a818-423b7f80508d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:22 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Volume volume-8480b52b-a222-4121-8cdb-552142827af4 (8480b52b-a222-4121-8cdb-552142827af4): created successfully Jul 06 12:38:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598703ac-9fe4-4cd3-a818-423b7f80508d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:22 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Flow 'volume_create_manager' (a184e3cb-0782-4dcf-9992-9bab107eee2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-8d62d225-ce07-4d97-aa6a-4a6a80583552 tempest-CreateVolumesFromSnapshotTest-300238410 None] Created volume successfully. Jul 06 12:38:22 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c" returned: 1 in 0.976s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:38:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:22 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c Jul 06 12:38:22 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:22 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728" returned: 0 in 1.131s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:22 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728 Jul 06 12:38:22 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:23 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f68bd3ea-57ac-4ad0-ad40-1bba3425942c" returned: 0 in 0.761s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-8480b52b-a222-4121-8cdb-552142827af4-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Lock "cinder-quobyte-f68bd3ea-57ac-4ad0-ad40-1bba3425942c" released by "delete_volume" :: held 2.966s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-8480b52b-a222-4121-8cdb-552142827af4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-quobyte-8480b52b-a222-4121-8cdb-552142827af4" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Created reservations ['785f5ccc-1921-4f05-9028-278a978768d0', 'ff4e4f46-7473-41b2-a56c-ba35e65f8847', 'da1f86e0-4864-46c1-886a-5d9e2fed4441', '15ff0319-04ad-440c-95fe-9d9456594486'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-8480b52b-a222-4121-8cdb-552142827af4" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[50292148-80ab-45d5-957d-8f5ed782592f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:23 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:23 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:23 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4 Jul 06 12:38:23 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:23 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fc75c6d-5fcc-4dd7-a765-165d0f36e728" returned: 0 in 1.086s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-6fc75c6d-5fcc-4dd7-a765-165d0f36e728" released by "delete_volume" :: held 2.272s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created reservations ['ec76776f-44a6-4037-a955-77ab8de7d816', 'eb93f523-2b76-49f7-9378-0e31f3178469', 'f540c773-b619-4648-8a04-0341f3108b70', 'dbe97624-6497-4a47-9ddf-a5c9ef01acd1'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:24 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:24 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:24 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.941s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:24 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Deleted volume successfully. Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-9c2005ee-a464-4210-a0fc-9a2491d49bc6 tempest-VolumeAndVolumeTypeFromImageTest-1160454185 None] Lock "cinder-f68bd3ea-57ac-4ad0-ad40-1bba3425942c-delete_volume" released by "delete_volume" :: held 4.319s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:24 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4" returned: 0 in 1.340s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:24 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4 Jul 06 12:38:24 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-b17af91c-d4bb-499b-9808-842714142b29-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-b17af91c-d4bb-499b-9808-842714142b29-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "cinder-quobyte-b17af91c-d4bb-499b-9808-842714142b29" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-b17af91c-d4bb-499b-9808-842714142b29" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:25 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.015s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Deleted volume successfully. Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[514b94eb-aaf0-4d68-bd29-1f6e04c34da1]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ad0dff66-4381-43f1-bd5c-1403bc866750 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-6fc75c6d-5fcc-4dd7-a765-165d0f36e728-delete_volume" released by "delete_volume" :: held 3.694s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:25 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29 Jul 06 12:38:25 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:25 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8480b52b-a222-4121-8cdb-552142827af4" returned: 0 in 1.139s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-8480b52b-a222-4121-8cdb-552142827af4" released by "delete_volume" :: held 2.536s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Created reservations ['4b874e55-1e57-4a6b-9c71-4390a4758567', '31496362-5e80-4a67-885d-41a1c6261da5', '87c06295-419f-4362-b4aa-2191e51debc1', '6e39a001-2931-414e-887d-b0d9f2343c77'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:25 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:25 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-e061ba9b-5d60-42b7-bce2-4adecffc0983-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-e061ba9b-5d60-42b7-bce2-4adecffc0983-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:26 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29" returned: 0 in 1.456s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:26 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29 Jul 06 12:38:26 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-quobyte-e061ba9b-5d60-42b7-bce2-4adecffc0983" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-e061ba9b-5d60-42b7-bce2-4adecffc0983" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f93639f-8c6a-4670-b8a6-d10edf918659]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:26 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.010s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:26 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Deleted volume successfully. Jul 06 12:38:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-42aae4a5-bdda-4d6d-ab79-a00a5f813f0d tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-8480b52b-a222-4121-8cdb-552142827af4-delete_volume" released by "delete_volume" :: held 3.879s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:27 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983 Jul 06 12:38:27 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:27 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b17af91c-d4bb-499b-9808-842714142b29" returned: 0 in 0.968s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-quobyte-b17af91c-d4bb-499b-9808-842714142b29" released by "delete_volume" :: held 2.496s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:27 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Created reservations ['f50bd610-2149-47c3-bef3-97effa0f03b7', '0da6bc2f-d3ab-4836-8aef-c0f03391e165', '9ea8f0d5-b57d-4aad-871f-763df21b2da5', '83fb56af-9745-4be5-925a-e98e3c36042f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:27 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:27 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:28 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983" returned: 0 in 1.188s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:28 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983 Jul 06 12:38:28 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:28 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.042s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:28 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:28 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e061ba9b-5d60-42b7-bce2-4adecffc0983" returned: 0 in 0.915s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Deleted volume successfully. Jul 06 12:38:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-e061ba9b-5d60-42b7-bce2-4adecffc0983" released by "delete_volume" :: held 2.186s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b9511907-7939-4564-bd36-264e5ee0be88 tempest-CreateVolumesFromSourceVolumeTest-1536668047 None] Lock "cinder-b17af91c-d4bb-499b-9808-842714142b29-delete_volume" released by "delete_volume" :: held 3.907s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:29 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Created reservations ['453ccc8e-738c-4cf0-a25b-6e974c2332e9', '19213d59-5860-4d90-83c6-51b003f272d0', 'f1f5337e-af60-4c22-bcfc-15796d600e82', 'c6221c77-e327-43c9-ad78-476dae431474'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:29 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:29 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-fe74f7e0-df71-4721-a324-83f018c9d02a-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-fe74f7e0-df71-4721-a324-83f018c9d02a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-quobyte-fe74f7e0-df71-4721-a324-83f018c9d02a" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-fe74f7e0-df71-4721-a324-83f018c9d02a" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:30 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.143s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:30 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[24850042-5616-45d7-9a5a-1383df1f495a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Deleted volume successfully. Jul 06 12:38:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e10e8bf8-c001-43f5-9dcf-d68ee59783da tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-e061ba9b-5d60-42b7-bce2-4adecffc0983-delete_volume" released by "delete_volume" :: held 3.684s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:30 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a Jul 06 12:38:30 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Flow 'volume_create_manager' (0bac9ead-bd28-4a6c-80ee-0e86cd7a2b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79a47d8-df80-4f9d-a224-83aba5a1e4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:31 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a" returned: 0 in 1.068s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79a47d8-df80-4f9d-a224-83aba5a1e4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675069498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbb4ed7-aa08-48e1-aa05-93fcaababcc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ba34145f94e56940c2d0441e5f591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:31Z,use_quota=True,user_id='41077c766cd245e6861b0661a10627cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:31 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a Jul 06 12:38:31 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c87dda4-d13b-4ded-b5a3-a2ee5400ea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c87dda4-d13b-4ded-b5a3-a2ee5400ea6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6521b84f-b1fa-4a7e-b250-8e6d74aa3c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6521b84f-b1fa-4a7e-b250-8e6d74aa3c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fbb4ed7-aa08-48e1-aa05-93fcaababcc9', 'volume_name': 'volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6a544e-df4e-46c6-8394-267f12e9547a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6a544e-df4e-46c6-8394-267f12e9547a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e372fe-e304-43af-8da8-8e8ba0ac9f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Volume 6fbb4ed7-aa08-48e1-aa05-93fcaababcc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9', 'volume_size': 1} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675069498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbb4ed7-aa08-48e1-aa05-93fcaababcc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ba34145f94e56940c2d0441e5f591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:31Z,use_quota=True,user_id='41077c766cd245e6861b0661a10627cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Creating volume 6fbb4ed7-aa08-48e1-aa05-93fcaababcc9 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:31 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:31 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9 1073741824 Jul 06 12:38:31 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Flow 'volume_create_manager' (5b432452-e14b-449b-9db1-103181989115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b08aa07-20c4-44c7-8dcf-9040c940c84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b08aa07-20c4-44c7-8dcf-9040c940c84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2014830466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272ed1fa-f158-429c-acff-4b20964b2c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ba34145f94e56940c2d0441e5f591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:32Z,use_quota=True,user_id='41077c766cd245e6861b0661a10627cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d42d05a-8608-476d-9351-fed12bc828a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d42d05a-8608-476d-9351-fed12bc828a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da784dcd-49d8-489d-acd0-eb7dc0e2e9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da784dcd-49d8-489d-acd0-eb7dc0e2e9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272ed1fa-f158-429c-acff-4b20964b2c91', 'volume_name': 'volume-272ed1fa-f158-429c-acff-4b20964b2c91', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f996e8-3682-4308-9320-7db175278f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f996e8-3682-4308-9320-7db175278f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f7cd3a-23f8-43e7-b5d6-9f37bf580355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:31 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Volume 272ed1fa-f158-429c-acff-4b20964b2c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272ed1fa-f158-429c-acff-4b20964b2c91', 'volume_size': 1} Jul 06 12:38:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Flow 'volume_create_manager' (c95478e5-19e9-46c2-a901-16d6024eb476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b591bb-16b3-4ec1-ba70-67ff41db3f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b591bb-16b3-4ec1-ba70-67ff41db3f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-218856598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcff31e-094f-456c-823e-c5452ec0ef06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ba34145f94e56940c2d0441e5f591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:32Z,use_quota=True,user_id='41077c766cd245e6861b0661a10627cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd591d3a-520b-4762-8d3d-3816a1d796fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd591d3a-520b-4762-8d3d-3816a1d796fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0adf68-68a7-49a8-85ff-61aedfc472d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0adf68-68a7-49a8-85ff-61aedfc472d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbcff31e-094f-456c-823e-c5452ec0ef06', 'volume_name': 'volume-cbcff31e-094f-456c-823e-c5452ec0ef06', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de21299-f12c-425f-b67b-49cee12cb610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de21299-f12c-425f-b67b-49cee12cb610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4977a0-4680-4f90-94b6-cda09adfd89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:32 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Volume cbcff31e-094f-456c-823e-c5452ec0ef06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbcff31e-094f-456c-823e-c5452ec0ef06', 'volume_size': 1} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:32 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-fe74f7e0-df71-4721-a324-83f018c9d02a" returned: 0 in 1.282s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-fe74f7e0-df71-4721-a324-83f018c9d02a" released by "delete_volume" :: held 2.481s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:32 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:32 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Created reservations ['1cd1cc0e-72c8-4f7e-84b1-6d0c0e3401ac', '8ea62683-9fd3-45b3-b7fb-de24050f187c', '216ada2e-c64a-49fe-9fec-5272ad508ee8', '4e2867e0-fe3e-4d29-86c2-f1fdb2030aea'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:33 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:33 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:33 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9 1073741824" returned: 0 in 1.887s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Flow 'volume_create_manager' (9ebf7c98-1c91-4877-817f-3ac62da0e8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62336298-58f2-4771-9564-1073212776f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:33 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.860s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:33 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9 Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62336298-58f2-4771-9564-1073212776f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1546733505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d974f3fd-cbcc-41bc-9b7c-ea89d963f346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ba34145f94e56940c2d0441e5f591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:33Z,use_quota=True,user_id='41077c766cd245e6861b0661a10627cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:33 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51de0087-b3a4-494f-b553-cf42af7763ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51de0087-b3a4-494f-b553-cf42af7763ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc27d51-3eb3-4378-a6db-2635413f7534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc27d51-3eb3-4378-a6db-2635413f7534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd974f3fd-cbcc-41bc-9b7c-ea89d963f346', 'volume_name': 'volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a93cce-8d8e-450e-88a4-d9e8a6edc9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a93cce-8d8e-450e-88a4-d9e8a6edc9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238680d4-0a82-4b29-aa54-e2b519b60e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:33 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Volume d974f3fd-cbcc-41bc-9b7c-ea89d963f346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346', 'volume_size': 1} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-7945d40b-5c0a-4b0a-9011-bd54c42317d2-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:38:33 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Flow 'volume_create_manager' (4745ea0d-fa37-46d6-9539-ccd6c46d924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edf1e29-75a3-460b-9e64-24a22247b794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-7945d40b-5c0a-4b0a-9011-bd54c42317d2-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edf1e29-75a3-460b-9e64-24a22247b794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-149488204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7da34d-ce58-40cc-9904-3c89a0f44958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ba34145f94e56940c2d0441e5f591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:34Z,use_quota=True,user_id='41077c766cd245e6861b0661a10627cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dd4f75-43b6-4063-8e9d-f2e57508488d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dd4f75-43b6-4063-8e9d-f2e57508488d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5896f5d6-9e5f-49e6-b59b-855c3650f4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5896f5d6-9e5f-49e6-b59b-855c3650f4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d7da34d-ce58-40cc-9904-3c89a0f44958', 'volume_name': 'volume-0d7da34d-ce58-40cc-9904-3c89a0f44958', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c59b144-a145-468d-9d93-4610f86876bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c59b144-a145-468d-9d93-4610f86876bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c7848b-81fe-4075-98f4-8acf65b8ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Volume 0d7da34d-ce58-40cc-9904-3c89a0f44958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d7da34d-ce58-40cc-9904-3c89a0f44958', 'volume_size': 1} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-quobyte-7945d40b-5c0a-4b0a-9011-bd54c42317d2" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-7945d40b-5c0a-4b0a-9011-bd54c42317d2" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb5e4a7-557b-46a9-8cce-e33cdc292c6d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:34 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2 Jul 06 12:38:34 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:34 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9" returned: 0 in 0.887s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] <== create_volume: return (3095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.100s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.770s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:34 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2014830466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272ed1fa-f158-429c-acff-4b20964b2c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ba34145f94e56940c2d0441e5f591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:32Z,use_quota=True,user_id='41077c766cd245e6861b0661a10627cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Creating volume 272ed1fa-f158-429c-acff-4b20964b2c91 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:34 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.477s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e372fe-e304-43af-8da8-8e8ba0ac9f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5dd124-03e6-4f54-b0a6-f04ef761a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:34 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91 1073741824 Jul 06 12:38:34 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Deleted volume successfully. Jul 06 12:38:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Volume volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9 (6fbb4ed7-aa08-48e1-aa05-93fcaababcc9): created successfully Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5dd124-03e6-4f54-b0a6-f04ef761a955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Flow 'volume_create_manager' (0bac9ead-bd28-4a6c-80ee-0e86cd7a2b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-95a0e318-6ad2-4536-9779-3feb8267a815 tempest-CreateVolumesFromImageTest-1247372198 None] Created volume successfully. Jul 06 12:38:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4086ab81-78e9-43f2-85d0-f9a264eafbf7 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-fe74f7e0-df71-4721-a324-83f018c9d02a-delete_volume" released by "delete_volume" :: held 4.608s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:35 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-cf2873d1-06dd-4957-a981-fe4cd3a2439b tempest-ProjectAdminTests-828344601 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7288703918457, 'free_capacity_gb': 1775.7288703918457, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86561) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 12:38:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2" returned: 0 in 1.139s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:35 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2 Jul 06 12:38:35 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:35 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91 1073741824" returned: 0 in 1.227s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:36 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91 Jul 06 12:38:36 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:36 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7945d40b-5c0a-4b0a-9011-bd54c42317d2" returned: 0 in 1.408s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-7945d40b-5c0a-4b0a-9011-bd54c42317d2" released by "delete_volume" :: held 2.647s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:36 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Created reservations ['ad2dfdeb-188f-4c77-a557-caa928a6d311', '2a073177-8bf0-490c-9a55-260c5df4e080', 'fb87f1fc-4f7c-46cf-95c7-76f6f61fedbe', '78e9c902-01cd-4b44-b7b6-2f00edfe6a12'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:37 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91" returned: 0 in 1.121s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] <== create_volume: return (2422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.582s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-218856598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbcff31e-094f-456c-823e-c5452ec0ef06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ba34145f94e56940c2d0441e5f591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:32Z,use_quota=True,user_id='41077c766cd245e6861b0661a10627cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Creating volume cbcff31e-094f-456c-823e-c5452ec0ef06 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:37 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:37 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06 1073741824 Jul 06 12:38:37 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f7cd3a-23f8-43e7-b5d6-9f37bf580355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272ed1fa-f158-429c-acff-4b20964b2c91', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce04bc0-55e7-40a8-a245-86870b458232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:37 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:37 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:37 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Volume volume-272ed1fa-f158-429c-acff-4b20964b2c91 (272ed1fa-f158-429c-acff-4b20964b2c91): created successfully Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce04bc0-55e7-40a8-a245-86870b458232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Flow 'volume_create_manager' (5b432452-e14b-449b-9db1-103181989115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0fa5f30d-7c63-4652-96b7-62c8ff58d046 tempest-CreateVolumesFromImageTest-1247372198 None] Created volume successfully. Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-1245ceb1-62df-4911-95f6-df9d91e56c4b-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-1245ceb1-62df-4911-95f6-df9d91e56c4b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-quobyte-1245ceb1-62df-4911-95f6-df9d91e56c4b" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-1245ceb1-62df-4911-95f6-df9d91e56c4b" acquired by "delete_volume" :: waited 0.048s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f20106-1d8c-4637-8d55-fe9e5134b959]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:38 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.936s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:38 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Deleted volume successfully. Jul 06 12:38:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30e2b48c-bbe7-4f0e-bdec-82dc47464211 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-7945d40b-5c0a-4b0a-9011-bd54c42317d2-delete_volume" released by "delete_volume" :: held 4.031s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:38 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b Jul 06 12:38:38 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:38 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06 1073741824" returned: 0 in 1.530s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:38 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06 Jul 06 12:38:38 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:39 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b" returned: 0 in 1.215s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:39 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b Jul 06 12:38:39 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:39 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06" returned: 0 in 0.838s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] <== create_volume: return (2424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.430s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.595s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1546733505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d974f3fd-cbcc-41bc-9b7c-ea89d963f346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ba34145f94e56940c2d0441e5f591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:33Z,use_quota=True,user_id='41077c766cd245e6861b0661a10627cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Creating volume d974f3fd-cbcc-41bc-9b7c-ea89d963f346 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:39 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:39 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346 1073741824 Jul 06 12:38:39 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4977a0-4680-4f90-94b6-cda09adfd89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbcff31e-094f-456c-823e-c5452ec0ef06', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da946aa7-23fb-4dfc-bfac-f0d226d71c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:39 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Volume volume-cbcff31e-094f-456c-823e-c5452ec0ef06 (cbcff31e-094f-456c-823e-c5452ec0ef06): created successfully Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da946aa7-23fb-4dfc-bfac-f0d226d71c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Flow 'volume_create_manager' (c95478e5-19e9-46c2-a901-16d6024eb476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a29d2627-5035-4a66-8e1e-49c5271331c0 tempest-CreateVolumesFromImageTest-1247372198 None] Created volume successfully. Jul 06 12:38:40 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1245ceb1-62df-4911-95f6-df9d91e56c4b" returned: 0 in 1.002s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-1245ceb1-62df-4911-95f6-df9d91e56c4b" released by "delete_volume" :: held 2.328s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:40 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Created reservations ['2ef97d90-4450-4643-b7d0-90643421da56', 'ed37a725-1088-410d-b7f6-2d92410ca216', '90f1d5b8-a2ab-46b0-99eb-1a89c9ad98e8', 'a00e0eca-a11f-447d-89f8-f520180051e0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:40 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:40 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:40 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346 1073741824" returned: 0 in 1.365s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:40 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346 Jul 06 12:38:40 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:41 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-c734c18c-016d-4ab8-b351-435501b39826-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.790s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Deleted volume successfully. Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-c734c18c-016d-4ab8-b351-435501b39826-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-quobyte-ce2ac9db-fc58-42b5-9612-9da307701bbe" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-ce2ac9db-fc58-42b5-9612-9da307701bbe" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-quobyte-c734c18c-016d-4ab8-b351-435501b39826" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-ce0df9fe-aaeb-46d8-8019-6a7c0c1d1a35 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-1245ceb1-62df-4911-95f6-df9d91e56c4b-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-c734c18c-016d-4ab8-b351-435501b39826" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Deleting offline snapshot c734c18c-016d-4ab8-b351-435501b39826 of volume ce2ac9db-fc58-42b5-9612-9da307701bbe {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] snapshot_file for this snap is: volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eec90a-fe1f-4dfe-b8c8-bc358d0d9240]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:41 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 Jul 06 12:38:41 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:41 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346" returned: 0 in 0.859s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] <== create_volume: return (2285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.638s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-149488204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7da34d-ce58-40cc-9904-3c89a0f44958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8ba34145f94e56940c2d0441e5f591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:34Z,use_quota=True,user_id='41077c766cd245e6861b0661a10627cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Creating volume 0d7da34d-ce58-40cc-9904-3c89a0f44958 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:41 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:41 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958 1073741824 Jul 06 12:38:41 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238680d4-0a82-4b29-aa54-e2b519b60e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256b8dcf-22a8-424b-8bfe-12e47f1ce91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:41 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Volume volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346 (d974f3fd-cbcc-41bc-9b7c-ea89d963f346): created successfully Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256b8dcf-22a8-424b-8bfe-12e47f1ce91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Flow 'volume_create_manager' (9ebf7c98-1c91-4877-817f-3ac62da0e8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2e2abaa5-c241-4e53-8518-8b94bee1e20f tempest-CreateVolumesFromImageTest-1247372198 None] Created volume successfully. Jul 06 12:38:42 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826" returned: 0 in 0.886s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce2ac9db-fc58-42b5-9612-9da307701bbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:38:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bab8b0-a076-490b-a7d0-daf012999bd9]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:42 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe Jul 06 12:38:42 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:43 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958 1073741824" returned: 0 in 1.307s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:43 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958 Jul 06 12:38:43 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:43 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe" returned: 0 in 1.144s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:43 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 Jul 06 12:38:43 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:43 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958" returned: 0 in 0.789s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c7848b-81fe-4075-98f4-8acf65b8ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d7da34d-ce58-40cc-9904-3c89a0f44958', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10be7e0e-c0bb-4e43-9da7-601f4367e82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:44 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Volume volume-0d7da34d-ce58-40cc-9904-3c89a0f44958 (0d7da34d-ce58-40cc-9904-3c89a0f44958): created successfully Jul 06 12:38:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10be7e0e-c0bb-4e43-9da7-601f4367e82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Flow 'volume_create_manager' (4745ea0d-fa37-46d6-9539-ccd6c46d924f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-92e0cf08-e0e4-4532-b63e-6a5c8d66fae5 tempest-CreateVolumesFromImageTest-1247372198 None] Created volume successfully. Jul 06 12:38:44 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826" returned: 0 in 1.005s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:44 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826 Jul 06 12:38:44 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "cinder-0d7da34d-ce58-40cc-9904-3c89a0f44958-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-0d7da34d-ce58-40cc-9904-3c89a0f44958-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "cinder-quobyte-0d7da34d-ce58-40cc-9904-3c89a0f44958" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-quobyte-0d7da34d-ce58-40cc-9904-3c89a0f44958" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[053ed66f-be70-41ff-b233-b9cdd6c53289]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:45 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe.c734c18c-016d-4ab8-b351-435501b39826" returned: 0 in 0.862s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:45 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958 Jul 06 12:38:45 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-c734c18c-016d-4ab8-b351-435501b39826" released by "_delete_snapshot" :: held 4.054s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-ce2ac9db-fc58-42b5-9612-9da307701bbe" released by "delete_snapshot" :: held 4.083s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:45 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Created reservations ['f0c37c6a-6b1c-4fb2-9799-ae8d8e29a43a', '71682391-42ea-40ce-8088-e816ffd0277a', 'a247f8b2-cefe-4912-80fb-5a9facc096cb', '6d8820ee-17af-4fca-98b7-38d209ea24fd'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:45 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Delete snapshot completed successfully. Jul 06 12:38:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fec1ff53-14cf-4d7e-9d71-6687eb85a4a9 tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-c734c18c-016d-4ab8-b351-435501b39826-delete_snapshot" released by "delete_snapshot" :: held 4.313s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:46 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958" returned: 0 in 0.981s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:46 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958 Jul 06 12:38:46 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-ce2ac9db-fc58-42b5-9612-9da307701bbe-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-ce2ac9db-fc58-42b5-9612-9da307701bbe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:46 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=140,cinder:SELECT=119,cinder:INSERT=39,cinder:DELETE=13 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:38:46 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=106,cinder:UPDATE=179,cinder:DELETE=18,cinder:INSERT=42 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:38:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "cinder-quobyte-ce2ac9db-fc58-42b5-9612-9da307701bbe" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-ce2ac9db-fc58-42b5-9612-9da307701bbe" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:46 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04e0f0-722d-458c-b69d-08d9fab96550]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:46 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe Jul 06 12:38:46 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:47 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0d7da34d-ce58-40cc-9904-3c89a0f44958" returned: 0 in 0.948s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-quobyte-0d7da34d-ce58-40cc-9904-3c89a0f44958" released by "delete_volume" :: held 1.988s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Created reservations ['0959d6cf-b424-4e15-805c-5685c9c6a39f', '596aa07c-7cd0-49f4-99a5-559add1299f0', '6c26432d-104c-4068-9e6b-3a4c96b2c7e1', '3031472f-689f-45a6-9e48-2a34c27c9167'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:47 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:47 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "cinder-d974f3fd-cbcc-41bc-9b7c-ea89d963f346-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-d974f3fd-cbcc-41bc-9b7c-ea89d963f346-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "cinder-quobyte-d974f3fd-cbcc-41bc-9b7c-ea89d963f346" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-quobyte-d974f3fd-cbcc-41bc-9b7c-ea89d963f346" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6fdd89-a770-4477-994d-bc768e14553e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:47 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346 Jul 06 12:38:47 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:47 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe" returned: 0 in 1.181s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:47 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe Jul 06 12:38:47 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:48 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.216s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:48 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:48 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Deleted volume successfully. Jul 06 12:38:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5f70dc49-b90b-4bed-80e5-8f424d06b39b tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-0d7da34d-ce58-40cc-9904-3c89a0f44958-delete_volume" released by "delete_volume" :: held 3.537s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:48 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346" returned: 0 in 1.180s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:48 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346 Jul 06 12:38:48 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:48 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-ce2ac9db-fc58-42b5-9612-9da307701bbe" returned: 0 in 0.894s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-quobyte-ce2ac9db-fc58-42b5-9612-9da307701bbe" released by "delete_volume" :: held 2.178s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:48 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Created reservations ['c0709667-5e48-4cbf-8bc5-650ab0cad7d8', '78c7c31d-0df8-4ad5-abaf-c90044a84ad9', '9a13d5d0-777d-4c95-b91e-b721f685a2e4', '58c17f18-ae65-4e0b-8f2f-0d43a1b76c85'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:49 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:49 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:49 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d974f3fd-cbcc-41bc-9b7c-ea89d963f346" returned: 0 in 1.085s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-quobyte-d974f3fd-cbcc-41bc-9b7c-ea89d963f346" released by "delete_volume" :: held 2.327s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Created reservations ['40494d28-c5d1-4569-93d7-cab1ea887c54', '8439cf29-804f-48aa-9457-ee172379073e', 'ffa15d4a-4d3e-45ef-9995-c2f7da79b4c3', '7a21aa36-d99e-46e0-8e27-28f1c9ed1914'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:50 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:50 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:50 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.996s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:50 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Deleted volume successfully. Jul 06 12:38:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-88f38cb4-8368-4545-a3b4-2dd080f1d2de tempest-CreateVolumesFromSnapshotTest-300238410 None] Lock "cinder-ce2ac9db-fc58-42b5-9612-9da307701bbe-delete_volume" released by "delete_volume" :: held 3.568s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:50 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "cinder-cbcff31e-094f-456c-823e-c5452ec0ef06-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.926s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:50 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:50 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Deleted volume successfully. Jul 06 12:38:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-cbcff31e-094f-456c-823e-c5452ec0ef06-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d712d5ff-5917-4089-b577-88f7f03157ee tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-d974f3fd-cbcc-41bc-9b7c-ea89d963f346-delete_volume" released by "delete_volume" :: held 3.575s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "cinder-quobyte-cbcff31e-094f-456c-823e-c5452ec0ef06" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:51 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-quobyte-cbcff31e-094f-456c-823e-c5452ec0ef06" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceca1dc-0cfa-49da-b02f-65373ff17a66]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:51 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06 Jul 06 12:38:51 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:52 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06" returned: 0 in 1.073s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:52 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06 Jul 06 12:38:52 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:53 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-cbcff31e-094f-456c-823e-c5452ec0ef06" returned: 0 in 0.999s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-quobyte-cbcff31e-094f-456c-823e-c5452ec0ef06" released by "delete_volume" :: held 2.169s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:53 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Created reservations ['dd0d877e-3e92-4bf2-bbba-97a0b245b6ec', 'e2087cc9-853e-456b-b490-3f1755855d88', '24006e32-9577-4def-8f05-08d6e96b29e6', 'f2a77f0d-5763-4ccf-bed1-96bc36525bae'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:53 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:53 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:54 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.881s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:54 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "cinder-272ed1fa-f158-429c-acff-4b20964b2c91-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Deleted volume successfully. Jul 06 12:38:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cf92d3c5-837d-4775-8798-8bcbd8ff2a45 tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-cbcff31e-094f-456c-823e-c5452ec0ef06-delete_volume" released by "delete_volume" :: held 3.485s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-272ed1fa-f158-429c-acff-4b20964b2c91-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "cinder-quobyte-272ed1fa-f158-429c-acff-4b20964b2c91" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-quobyte-272ed1fa-f158-429c-acff-4b20964b2c91" acquired by "delete_volume" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b5c594-3a3e-48e5-a81d-41b3d4ea3b85]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:54 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91 Jul 06 12:38:54 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Flow 'volume_create_manager' (c9323f38-809c-4885-93f5-19f8943f67c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe8116a-6bb8-494f-ac3d-25f113878b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe8116a-6bb8-494f-ac3d-25f113878b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-456103684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1523e01-5adb-4154-bfb5-42882d064f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de30118212a4b9b83cc0757ae465845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:55Z,use_quota=True,user_id='d9b671adafd745269bc52446d06d3b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc1326e-fc60-4ae4-a2c5-a0daf12aad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc1326e-fc60-4ae4-a2c5-a0daf12aad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96f8ece-528f-42f0-8f5a-6abcb7ba26ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96f8ece-528f-42f0-8f5a-6abcb7ba26ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1523e01-5adb-4154-bfb5-42882d064f38', 'volume_name': 'volume-e1523e01-5adb-4154-bfb5-42882d064f38', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a779c4-4761-4f43-9c57-dd76f58dd473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a779c4-4761-4f43-9c57-dd76f58dd473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d9dcc5-54ca-4ce7-9af0-842cc3835fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:55 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Volume e1523e01-5adb-4154-bfb5-42882d064f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1523e01-5adb-4154-bfb5-42882d064f38', 'volume_size': 1} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-456103684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1523e01-5adb-4154-bfb5-42882d064f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de30118212a4b9b83cc0757ae465845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:55Z,use_quota=True,user_id='d9b671adafd745269bc52446d06d3b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Creating volume e1523e01-5adb-4154-bfb5-42882d064f38 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:38:55 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:55 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 1073741824 Jul 06 12:38:55 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:55 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91" returned: 0 in 1.263s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:55 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91 Jul 06 12:38:55 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:56 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 1073741824" returned: 0 in 1.152s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:56 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 Jul 06 12:38:56 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:57 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-272ed1fa-f158-429c-acff-4b20964b2c91" returned: 0 in 1.099s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-quobyte-272ed1fa-f158-429c-acff-4b20964b2c91" released by "delete_volume" :: held 2.458s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Created reservations ['7b45439e-b143-460c-a3e3-6e60aa930f09', '2fea53b7-8517-4339-bf34-4b1d1ba520b5', '624695a6-9a5f-479d-98cd-2d9bdaaa7440', '7cd94bab-dc84-4e8b-b581-e092a32e995e'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:57 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:57 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:57 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38" returned: 0 in 1.026s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d9dcc5-54ca-4ce7-9af0-842cc3835fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1523e01-5adb-4154-bfb5-42882d064f38', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb23684-4584-42e3-94e3-70d11a9a167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Volume volume-e1523e01-5adb-4154-bfb5-42882d064f38 (e1523e01-5adb-4154-bfb5-42882d064f38): created successfully Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb23684-4584-42e3-94e3-70d11a9a167d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Flow 'volume_create_manager' (c9323f38-809c-4885-93f5-19f8943f67c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4dda2f8f-4c3a-4286-b752-d0cbf9196107 tempest-VolumeDependencyTests-290930597 None] Created volume successfully. Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "cinder-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "cinder-quobyte-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-quobyte-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[64377ef1-296d-468b-9be8-4ca4ec80adc6]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:58 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9 Jul 06 12:38:58 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:58 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.850s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:38:58 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Deleted volume successfully. Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bacc0f80-29b1-4262-b116-5f301b4e5ceb tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-272ed1fa-f158-429c-acff-4b20964b2c91-delete_volume" released by "delete_volume" :: held 3.818s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Flow 'volume_create_manager' (46fd04ce-8046-4567-955d-10ced0402762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80bbb31e-5dbf-474a-9c6d-0c58cc1b6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] Creating offline snapshot 4c011985-79d0-411e-af08-3d15780a277d of volume e1523e01-5adb-4154-bfb5-42882d064f38 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80bbb31e-5dbf-474a-9c6d-0c58cc1b6e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1109520803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71c9e02-4af0-431d-8e93-8048db186ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6f068f75424d46bc5d4c18ac7b477a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:59Z,use_quota=True,user_id='fa4b5dadae3745d29ffceef9c010f5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70991ec-b281-4ab7-974e-f9a16e5c4b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70991ec-b281-4ab7-974e-f9a16e5c4b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d675c40e-0d09-4d3d-8b2f-8f7a99594554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d675c40e-0d09-4d3d-8b2f-8f7a99594554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd71c9e02-4af0-431d-8e93-8048db186ead', 'volume_name': 'volume-d71c9e02-4af0-431d-8e93-8048db186ead', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:58 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5ed8cb-8c59-4a7b-ae5d-f7e0df17d9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5ed8cb-8c59-4a7b-ae5d-f7e0df17d9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f94f53-d100-4acc-91e7-e69f5c7cec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Volume d71c9e02-4af0-431d-8e93-8048db186ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d71c9e02-4af0-431d-8e93-8048db186ead', 'volume_size': 1} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecc13b0-905b-488a-a254-cac3dd1881dc]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9" returned: 0 in 0.981s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:59 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9 Jul 06 12:38:59 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:59 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 Jul 06 12:38:59 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Flow 'volume_create_manager' (ab52ec0c-5cb4-48dc-9bbd-76227ca23c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7ce392-acae-4324-8b01-a2abd0d84e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7ce392-acae-4324-8b01-a2abd0d84e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914885960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e15379-54df-41a0-9dc9-946cd856dcce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86cfb03321c4458852809e50a9aa5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:59Z,use_quota=True,user_id='65e60e020808458db53d65616d623209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c05977-adaa-4d63-81b3-2764897e41e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c05977-adaa-4d63-81b3-2764897e41e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86956ab2-e0b0-4f21-96ea-7ffc7acd5747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86956ab2-e0b0-4f21-96ea-7ffc7acd5747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e15379-54df-41a0-9dc9-946cd856dcce', 'volume_name': 'volume-f4e15379-54df-41a0-9dc9-946cd856dcce', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8981790e-9056-48aa-8e97-0ad90161310a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8981790e-9056-48aa-8e97-0ad90161310a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0844abb-426b-4b80-896d-5857b8bcc7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:38:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Volume f4e15379-54df-41a0-9dc9-946cd856dcce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e15379-54df-41a0-9dc9-946cd856dcce', 'volume_size': 1} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:59 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9" returned: 0 in 0.756s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-quobyte-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9" released by "delete_volume" :: held 1.788s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Created reservations ['59fbfb34-5a46-4388-b380-50ff1c9df83c', 'a1608294-fa43-498c-b367-f1c5058b4d64', 'ad046d0e-15be-44d8-9d2d-9c8872da083f', '91af33e5-c57f-42fb-b2c6-b996322e1970'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:38:59 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38" returned: 0 in 0.901s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:38:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:38:59 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d 1G Jul 06 12:38:59 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:38:59 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:38:59 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:00 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.743s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:00 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Deleted volume successfully. Jul 06 12:39:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bfda2abc-9b44-4031-a09f-fee25e8769ab tempest-CreateVolumesFromImageTest-1247372198 None] Lock "cinder-6fbb4ed7-aa08-48e1-aa05-93fcaababcc9-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:00 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d 1G" returned: 0 in 0.999s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1523e01-5adb-4154-bfb5-42882d064f38 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:00 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1523e01-5adb-4154-bfb5-42882d064f38 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d Jul 06 12:39:00 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:01 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1523e01-5adb-4154-bfb5-42882d064f38 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d" returned: 0 in 0.799s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:01 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d is being set with open permissions: ugo+rw Jul 06 12:39:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:01 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d Jul 06 12:39:01 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:02 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d" returned: 0 in 0.705s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:02 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.info Jul 06 12:39:02 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:03 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.info" returned: 0 in 0.748s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:03 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.info is being set with open permissions: ugo+rw Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:03 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.info Jul 06 12:39:03 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:03 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.info" returned: 0 in 0.752s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.121s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1109520803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71c9e02-4af0-431d-8e93-8048db186ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6f068f75424d46bc5d4c18ac7b477a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:59Z,use_quota=True,user_id='fa4b5dadae3745d29ffceef9c010f5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Creating volume d71c9e02-4af0-431d-8e93-8048db186ead {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:39:03 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:39:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:04 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead 1073741824 Jul 06 12:39:04 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-978cd2fe-00ed-435f-9a30-1d725b4852fa tempest-VolumeDependencyTests-290930597 None] Create snapshot completed successfully Jul 06 12:39:04 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead 1073741824" returned: 0 in 0.973s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:05 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead Jul 06 12:39:05 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Flow 'volume_create_manager' (258ef87c-921f-4dfd-856a-d015bee27e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e87ebd6-c513-4b1a-a3cd-eda6a812811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e87ebd6-c513-4b1a-a3cd-eda6a812811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1690777078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffdf811-b3e7-4215-92ce-635803f3a213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de30118212a4b9b83cc0757ae465845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c011985-79d0-411e-af08-3d15780a277d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:06Z,use_quota=True,user_id='d9b671adafd745269bc52446d06d3b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa5f807-7e25-45b5-8bef-6b60d8252cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa5f807-7e25-45b5-8bef-6b60d8252cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a447d1e-fb4b-4d0d-9b3c-d91534b444db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a447d1e-fb4b-4d0d-9b3c-d91534b444db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ffdf811-b3e7-4215-92ce-635803f3a213', 'volume_name': 'volume-0ffdf811-b3e7-4215-92ce-635803f3a213', 'volume_size': 1, 'snapshot_id': '4c011985-79d0-411e-af08-3d15780a277d'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b4fbca-7a9d-4c68-bf8b-8608a7cecb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:05 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b4fbca-7a9d-4c68-bf8b-8608a7cecb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11615a7-1d79-478c-ad5d-d9bcfa995076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Volume 0ffdf811-b3e7-4215-92ce-635803f3a213: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ffdf811-b3e7-4215-92ce-635803f3a213', 'volume_size': 1, 'snapshot_id': '4c011985-79d0-411e-af08-3d15780a277d'} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead" returned: 0 in 0.818s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.149s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914885960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e15379-54df-41a0-9dc9-946cd856dcce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86cfb03321c4458852809e50a9aa5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:38:59Z,use_quota=True,user_id='65e60e020808458db53d65616d623209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Creating volume f4e15379-54df-41a0-9dc9-946cd856dcce {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:39:05 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f94f53-d100-4acc-91e7-e69f5c7cec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71c9e02-4af0-431d-8e93-8048db186ead', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:05 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce 1073741824 Jul 06 12:39:05 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9314f97d-8b3c-44c2-a9e1-aa510a575a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Volume volume-d71c9e02-4af0-431d-8e93-8048db186ead (d71c9e02-4af0-431d-8e93-8048db186ead): created successfully Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9314f97d-8b3c-44c2-a9e1-aa510a575a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Flow 'volume_create_manager' (46fd04ce-8046-4567-955d-10ced0402762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-06ddc61f-3864-4667-a005-b46a22a5306b tempest-SnapshotDependencyTests-692247165 None] Created volume successfully. Jul 06 12:39:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:06 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce 1073741824" returned: 0 in 0.979s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:06 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce Jul 06 12:39:06 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Flow 'volume_create_manager' (55c0f15d-5421-412f-a49c-bc102dbaf3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967e700e-8e19-4715-8d8b-a233be2069bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967e700e-8e19-4715-8d8b-a233be2069bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b380e5d7-77c1-43a9-9b5e-fc9079d059a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d22205e0d4449a9a607b9e068f7a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:07Z,use_quota=True,user_id='d45bc4f014e9461bb208ff2c31c8428a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f0b309-5299-46b4-889c-c5c351b2733d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f0b309-5299-46b4-889c-c5c351b2733d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35d11aa-2885-4738-885a-72cef9e66757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.image.glance [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Creating Keystone auth plugin from conf {{(pid=86561) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35d11aa-2885-4738-885a-72cef9e66757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b380e5d7-77c1-43a9-9b5e-fc9079d059a8', 'volume_name': 'volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8', 'volume_size': 1, 'image_id': '49192ccd-2851-412b-878b-795194eb3077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49192ccd-2851-412b-878b-795194eb3077', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33392f973f8bb0b4f95de83aec36156c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27d22205e0d4449a9a607b9e068f7a1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c5140389e622845143ee25e976707881c75150d27a029bda67dde54e85b6be4fbca71aff92c67933d70007c74bb6e437c1db4046178f9de03c710447c89c5c87', 'id': '49192ccd-2851-412b-878b-795194eb3077', 'created_at': datetime.datetime(2026, 7, 6, 10, 39, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 39, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49192ccd-2851-412b-878b-795194eb3077/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e051c0-c8a8-412a-8e19-c310ef529b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e051c0-c8a8-412a-8e19-c310ef529b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07869dd-bead-4973-a713-c58d137648b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Volume b380e5d7-77c1-43a9-9b5e-fc9079d059a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8', 'volume_size': 1, 'image_id': '49192ccd-2851-412b-878b-795194eb3077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49192ccd-2851-412b-878b-795194eb3077', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33392f973f8bb0b4f95de83aec36156c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27d22205e0d4449a9a607b9e068f7a1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c5140389e622845143ee25e976707881c75150d27a029bda67dde54e85b6be4fbca71aff92c67933d70007c74bb6e437c1db4046178f9de03c710447c89c5c87', 'id': '49192ccd-2851-412b-878b-795194eb3077', 'created_at': datetime.datetime(2026, 7, 6, 10, 39, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 39, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49192ccd-2851-412b-878b-795194eb3077/file', 'properties': {}}, 'image_service': } Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Trying to clone b380e5d7-77c1-43a9-9b5e-fc9079d059a8 from image 49192ccd-2851-412b-878b-795194eb3077 at location (None, [{'url': 'file:///opt/stack/data/glance/images/49192ccd-2851-412b-878b-795194eb3077', 'metadata': {}}]). {{(pid=86561) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 12:39:07 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Image download 0.00 MB at 0.00 MB/s Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e272f0-02d2-46b6-8a7e-947291c56a1a]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:07 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce" returned: 0 in 0.707s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.708s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Acquiring lock "cinder-quobyte-4c011985-79d0-411e-af08-3d15780a277d-0ffdf811-b3e7-4215-92ce-635803f3a213" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0844abb-426b-4b80-896d-5857b8bcc7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e15379-54df-41a0-9dc9-946cd856dcce', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9479773b-117d-4004-9478-dd556ae7ca9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:07 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD Jul 06 12:39:07 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-4c011985-79d0-411e-af08-3d15780a277d-0ffdf811-b3e7-4215-92ce-635803f3a213" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Creating volume 0ffdf811-b3e7-4215-92ce-635803f3a213 from snapshot 4c011985-79d0-411e-af08-3d15780a277d {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Acquiring lock "cinder-quobyte-0ffdf811-b3e7-4215-92ce-635803f3a213" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:07 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Volume volume-f4e15379-54df-41a0-9dc9-946cd856dcce (f4e15379-54df-41a0-9dc9-946cd856dcce): created successfully Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9479773b-117d-4004-9478-dd556ae7ca9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Flow 'volume_create_manager' (ab52ec0c-5cb4-48dc-9bbd-76227ca23c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-0ffdf811-b3e7-4215-92ce-635803f3a213" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] snapshot: 4c011985-79d0-411e-af08-3d15780a277d, volume: 0ffdf811-b3e7-4215-92ce-635803f3a213, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:07 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f8f4ba10-0260-4761-9a6d-2916057ed632 tempest-ProjectReaderTests-1964193583 None] Created volume successfully. Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0029389-6a3f-4e9c-b1bd-0602be36db40]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:07 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d Jul 06 12:39:07 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:08 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD" returned: 0 in 0.809s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Acquiring lock "cinder-f4e15379-54df-41a0-9dc9-946cd856dcce-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Lock "cinder-f4e15379-54df-41a0-9dc9-946cd856dcce-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Acquiring lock "cinder-quobyte-f4e15379-54df-41a0-9dc9-946cd856dcce" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:08 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD Jul 06 12:39:08 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Lock "cinder-quobyte-f4e15379-54df-41a0-9dc9-946cd856dcce" acquired by "delete_volume" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccebc116-a79d-4d85-88bb-e5622ee8782d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:08 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce Jul 06 12:39:08 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:08 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d" returned: 0 in 0.953s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1523e01-5adb-4154-bfb5-42882d064f38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f130a6-c6d8-45f1-967f-25fa25d2e0d3]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:08 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 Jul 06 12:39:08 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:09 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD" returned: 1 in 0.940s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:39:09 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Temporary image 49192ccd-2851-412b-878b-795194eb3077 is fetched for user d45bc4f014e9461bb208ff2c31c8428a. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 12:39:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39e3855-17ee-47f3-b3d1-d502e34b8be9]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:09 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce" returned: 0 in 0.835s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:09 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce Jul 06 12:39:09 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:09 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD Jul 06 12:39:09 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:09 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38" returned: 0 in 0.825s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:09 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213 not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:39:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:09 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213 Jul 06 12:39:09 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:10 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f4e15379-54df-41a0-9dc9-946cd856dcce" returned: 0 in 0.774s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Lock "cinder-quobyte-f4e15379-54df-41a0-9dc9-946cd856dcce" released by "delete_volume" :: held 1.664s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:10 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:10 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Created reservations ['dda3d0b0-bde6-41df-b257-58c64ca046b6', '0d843f05-a822-45d9-87f1-b5975467b854', '3610b8e5-3012-4009-bc87-dd02dc579c5e', 'dbb8e520-5b25-447f-b43a-c88af2ab5fe5'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:10 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD Jul 06 12:39:10 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:10 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:39:10 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:11 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD" returned: 1 in 1.463s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:39:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:11 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:39:11 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Flow 'volume_create_manager' (fecbccdb-1a9f-4bc8-a125-2d6bf5ef1da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018b7c52-5f0b-4641-a7b4-2bed49b988d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.780s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Deleted volume successfully. Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018b7c52-5f0b-4641-a7b4-2bed49b988d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1775059949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293389fd-87f2-44d4-8183-c402da1be354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86cfb03321c4458852809e50a9aa5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:12Z,use_quota=True,user_id='65e60e020808458db53d65616d623209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2ce449-d1de-4006-955f-5fcd2bf1254c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2ce449-d1de-4006-955f-5fcd2bf1254c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4a9069-ac73-4451-8aa8-e36ec238371f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4a9069-ac73-4451-8aa8-e36ec238371f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '293389fd-87f2-44d4-8183-c402da1be354', 'volume_name': 'volume-293389fd-87f2-44d4-8183-c402da1be354', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895bc2c3-9592-4057-976c-0e114c6f2f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895bc2c3-9592-4057-976c-0e114c6f2f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b1fed8-a648-4642-8b93-527e2d06d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Volume 293389fd-87f2-44d4-8183-c402da1be354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-293389fd-87f2-44d4-8183-c402da1be354', 'volume_size': 1} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:12 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e8e8e328-b1b8-4045-bd02-8c9ead475af1 tempest-ProjectReaderTests-1964193583 None] Lock "cinder-f4e15379-54df-41a0-9dc9-946cd856dcce-delete_volume" released by "delete_volume" :: held 3.939s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:15 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213" returned: 0 in 5.640s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:15 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[81809b4e-daab-497d-82e3-061fa202e362]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:15 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 Jul 06 12:39:15 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:16 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38" returned: 0 in 0.995s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:16 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:39:16 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Converted 1024.00 MB image at 181.54 MB/s Jul 06 12:39:16 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213 is being set with open permissions: ugo+rw Jul 06 12:39:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:16 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213 Jul 06 12:39:16 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:16 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213" returned: 0 in 0.780s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-0ffdf811-b3e7-4215-92ce-635803f3a213" released by "_copy_volume_from_snapshot" :: held 9.311s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:16 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-4c011985-79d0-411e-af08-3d15780a277d-0ffdf811-b3e7-4215-92ce-635803f3a213" released by "_create_volume_from_snapshot" :: held 9.363s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.401s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.412s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] Creating offline snapshot d55f45d4-10d4-4d7d-acec-3b540bf2b830 of volume d71c9e02-4af0-431d-8e93-8048db186ead {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11615a7-1d79-478c-ad5d-d9bcfa995076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ffdf811-b3e7-4215-92ce-635803f3a213', 'volume_size': 1, 'snapshot_id': '4c011985-79d0-411e-af08-3d15780a277d'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe162e2-bacc-46fe-b91f-9d8f6d04e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeebc2f-7d89-465f-8faf-ee7c4a833677]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:17 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Volume volume-0ffdf811-b3e7-4215-92ce-635803f3a213 (0ffdf811-b3e7-4215-92ce-635803f3a213): created successfully Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe162e2-bacc-46fe-b91f-9d8f6d04e275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Flow 'volume_create_manager' (258ef87c-921f-4dfd-856a-d015bee27e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-30414e9a-4c93-447d-92d5-1d743ef5b76f tempest-VolumeDependencyTests-290930597 None] Created volume successfully. Jul 06 12:39:17 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead Jul 06 12:39:17 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Acquiring lock "cinder-4c011985-79d0-411e-af08-3d15780a277d-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Lock "cinder-4c011985-79d0-411e-af08-3d15780a277d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Acquiring lock "cinder-quobyte-e1523e01-5adb-4154-bfb5-42882d064f38" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-e1523e01-5adb-4154-bfb5-42882d064f38" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Acquiring lock "cinder-quobyte-4c011985-79d0-411e-af08-3d15780a277d" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-4c011985-79d0-411e-af08-3d15780a277d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:17 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Deleting offline snapshot 4c011985-79d0-411e-af08-3d15780a277d of volume e1523e01-5adb-4154-bfb5-42882d064f38 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] snapshot_file for this snap is: volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead" returned: 0 in 0.906s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0c8e29-0f79-45d7-a7a1-05125262ff56]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:17 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 1G Jul 06 12:39:17 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:18 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d Jul 06 12:39:18 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:18 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d" returned: 0 in 0.927s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1523e01-5adb-4154-bfb5-42882d064f38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:39:18 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 1G" returned: 0 in 0.961s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d71c9e02-4af0-431d-8e93-8048db186ead -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5345f509-03f1-46df-8ddb-d68602073de1]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:18 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d71c9e02-4af0-431d-8e93-8048db186ead -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 Jul 06 12:39:18 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:19 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 Jul 06 12:39:19 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:19 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d71c9e02-4af0-431d-8e93-8048db186ead -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830" returned: 0 in 0.765s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:19 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 is being set with open permissions: ugo+rw Jul 06 12:39:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:19 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 Jul 06 12:39:19 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:19 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38" returned: 0 in 0.866s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:19 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d Jul 06 12:39:19 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:20 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830" returned: 0 in 0.724s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:20 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.info Jul 06 12:39:20 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:20 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d" returned: 0 in 0.862s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:20 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d Jul 06 12:39:20 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:21 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.info" returned: 0 in 0.765s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:21 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.info is being set with open permissions: ugo+rw Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:21 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.info Jul 06 12:39:21 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:21 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38.4c011985-79d0-411e-af08-3d15780a277d" returned: 0 in 0.836s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-4c011985-79d0-411e-af08-3d15780a277d" released by "_delete_snapshot" :: held 3.637s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-e1523e01-5adb-4154-bfb5-42882d064f38" released by "delete_snapshot" :: held 3.666s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Created reservations ['a6cc9a33-20ec-4446-a283-ddceef873c80', '0ad56f57-2e56-4f30-bc56-75bec8052b50', '8de479ff-7772-4f51-ab4e-724388926f9c', '5db2fe6d-e18b-43f2-9ae9-a7699574c2b4'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Delete snapshot completed successfully. Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-01eb934a-a78e-41d2-8433-22127b1a5cfc tempest-VolumeDependencyTests-290930597 None] Lock "cinder-4c011985-79d0-411e-af08-3d15780a277d-delete_snapshot" released by "delete_snapshot" :: held 3.855s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:21 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.info" returned: 0 in 0.720s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.967s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.332s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b380e5d7-77c1-43a9-9b5e-fc9079d059a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d22205e0d4449a9a607b9e068f7a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:07Z,use_quota=True,user_id='d45bc4f014e9461bb208ff2c31c8428a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Creating volume b380e5d7-77c1-43a9-9b5e-fc9079d059a8 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:39:21 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:39:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:21 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 1073741824 Jul 06 12:39:21 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-df53f462-6f36-460a-899e-7f6ef11ca0bc tempest-SnapshotDependencyTests-692247165 None] Create snapshot completed successfully Jul 06 12:39:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Acquiring lock "cinder-e1523e01-5adb-4154-bfb5-42882d064f38-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Lock "cinder-e1523e01-5adb-4154-bfb5-42882d064f38-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Acquiring lock "cinder-quobyte-e1523e01-5adb-4154-bfb5-42882d064f38" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-e1523e01-5adb-4154-bfb5-42882d064f38" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ff47c0-ffd1-4ede-836f-248d8f2562c6]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:22 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 Jul 06 12:39:22 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:23 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 1073741824" returned: 0 in 1.076s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:23 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 Jul 06 12:39:23 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Flow 'volume_create_manager' (94d88618-9d97-4c15-9709-c9abf6a7ff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b34843-07ab-47b7-88ca-e2a30540d8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b34843-07ab-47b7-88ca-e2a30540d8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45254ba6-a4e1-40ca-afb0-ec0e373a0a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6f068f75424d46bc5d4c18ac7b477a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d55f45d4-10d4-4d7d-acec-3b540bf2b830,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:23Z,use_quota=True,user_id='fa4b5dadae3745d29ffceef9c010f5a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78ba262-a7cc-444b-9774-4ce97e5fbc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78ba262-a7cc-444b-9774-4ce97e5fbc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08456d23-7694-4b5d-8f35-4a17a6c36813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08456d23-7694-4b5d-8f35-4a17a6c36813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45254ba6-a4e1-40ca-afb0-ec0e373a0a8a', 'volume_name': 'volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a', 'volume_size': 1, 'snapshot_id': 'd55f45d4-10d4-4d7d-acec-3b540bf2b830'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fbbbd6e-439c-4649-a16d-dd3adb16e759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fbbbd6e-439c-4649-a16d-dd3adb16e759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea9c0b2-0a2f-4f41-aec2-ef477a4ac074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Volume 45254ba6-a4e1-40ca-afb0-ec0e373a0a8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a', 'volume_size': 1, 'snapshot_id': 'd55f45d4-10d4-4d7d-acec-3b540bf2b830'} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:23 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38" returned: 0 in 1.093s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:23 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38 Jul 06 12:39:23 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:23 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8" returned: 0 in 0.803s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.653s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1775059949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293389fd-87f2-44d4-8183-c402da1be354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a86cfb03321c4458852809e50a9aa5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:12Z,use_quota=True,user_id='65e60e020808458db53d65616d623209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Creating volume 293389fd-87f2-44d4-8183-c402da1be354 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:39:23 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:23 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354 1073741824 Jul 06 12:39:23 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:23 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Attempting download of 49192ccd-2851-412b-878b-795194eb3077 ((None, [{'url': 'file:///opt/stack/data/glance/images/49192ccd-2851-412b-878b-795194eb3077', 'metadata': {}}])) to volume b380e5d7-77c1-43a9-9b5e-fc9079d059a8. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[002fa29f-69b8-4816-b2df-b9f7503254e4]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49192ccd-2851-412b-878b-795194eb3077_nh5x7fji {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:24 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e1523e01-5adb-4154-bfb5-42882d064f38" returned: 0 in 0.763s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:24 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49192ccd-2851-412b-878b-795194eb3077_nh5x7fji Jul 06 12:39:24 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-e1523e01-5adb-4154-bfb5-42882d064f38" released by "delete_volume" :: held 1.938s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Created reservations ['204157a7-d409-421d-92db-9e0fbe7264a8', 'd70c65ec-479d-437f-aab2-c6b83c2b7f05', '414f7709-0fd2-46ef-8904-da19872c2712', 'c84c4f9c-6769-4fbc-a4ec-561b0818049f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:24 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:39:24 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Acquiring lock "cinder-0ffdf811-b3e7-4215-92ce-635803f3a213-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Lock "cinder-0ffdf811-b3e7-4215-92ce-635803f3a213-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Acquiring lock "cinder-quobyte-0ffdf811-b3e7-4215-92ce-635803f3a213" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-0ffdf811-b3e7-4215-92ce-635803f3a213" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[17da712a-1719-4cfb-ba85-1d1da5608e84]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:24 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213 Jul 06 12:39:24 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:24 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_49192ccd-2851-412b-878b-795194eb3077_nh5x7fji" returned: 0 in 0.875s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49192ccd-2851-412b-878b-795194eb3077_nh5x7fji {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:25 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49192ccd-2851-412b-878b-795194eb3077_nh5x7fji Jul 06 12:39:25 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:25 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354 1073741824" returned: 0 in 1.244s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:25 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.881s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Deleted volume successfully. Jul 06 12:39:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-7e80174b-078c-4302-b20b-d5f98fd325f1 tempest-VolumeDependencyTests-290930597 None] Lock "cinder-e1523e01-5adb-4154-bfb5-42882d064f38-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:25 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354 Jul 06 12:39:25 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:25 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213" returned: 0 in 1.100s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:25 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213 Jul 06 12:39:25 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:25 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49192ccd-2851-412b-878b-795194eb3077_nh5x7fji" returned: 1 in 0.853s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_49192ccd-2851-412b-878b-795194eb3077_nh5x7fji' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:39:25 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[77328f46-7fd9-4186-aa0d-43d68d700525]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:25 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD Jul 06 12:39:25 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:26 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354" returned: 0 in 0.769s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.697s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "cinder-quobyte-d55f45d4-10d4-4d7d-acec-3b540bf2b830-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" by "_create_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b1fed8-a648-4642-8b93-527e2d06d48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-293389fd-87f2-44d4-8183-c402da1be354', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8b6030-a6da-4ff3-b5e8-1fa5da903079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-d55f45d4-10d4-4d7d-acec-3b540bf2b830-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Creating volume 45254ba6-a4e1-40ca-afb0-ec0e373a0a8a from snapshot d55f45d4-10d4-4d7d-acec-3b540bf2b830 {{(pid=86561) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "cinder-quobyte-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" by "_copy_volume_from_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:26 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Volume volume-293389fd-87f2-44d4-8183-c402da1be354 (293389fd-87f2-44d4-8183-c402da1be354): created successfully Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8b6030-a6da-4ff3-b5e8-1fa5da903079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Flow 'volume_create_manager' (fecbccdb-1a9f-4bc8-a125-2d6bf5ef1da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] snapshot: d55f45d4-10d4-4d7d-acec-3b540bf2b830, volume: 45254ba6-a4e1-40ca-afb0-ec0e373a0a8a, {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 12:39:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-129151ad-c0a5-4558-bcb6-d42362294ef1 tempest-ProjectReaderTests-1964193583 None] Created volume successfully. Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1c1f3b-38f9-4ca3-99ba-50b6989034f9]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:26 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 Jul 06 12:39:26 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:26 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-0ffdf811-b3e7-4215-92ce-635803f3a213" returned: 0 in 0.793s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Lock "cinder-quobyte-0ffdf811-b3e7-4215-92ce-635803f3a213" released by "delete_volume" :: held 1.974s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Created reservations ['5668d869-2133-441f-9e77-b3050f6bf36e', '4b200e58-c87b-486c-b11a-874f843c7b3e', '5a99932b-6736-4ad4-93d6-7de941cefd59', '2a00cfb9-52dd-4ad1-969b-e2b81a0a55bb'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:26 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:26 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:39:26 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:26 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD Jul 06 12:39:26 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Acquiring lock "cinder-293389fd-87f2-44d4-8183-c402da1be354-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Lock "cinder-293389fd-87f2-44d4-8183-c402da1be354-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Acquiring lock "cinder-quobyte-293389fd-87f2-44d4-8183-c402da1be354" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Lock "cinder-quobyte-293389fd-87f2-44d4-8183-c402da1be354" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:27 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830" returned: 0 in 0.967s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d71c9e02-4af0-431d-8e93-8048db186ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Creating direct copy from snapshot {{(pid=86561) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ca477a-0dbf-46e7-a713-7a4e1f40c052]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeaee3b-e69d-49a5-b438-aa289fb18e7a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:27 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354 Jul 06 12:39:27 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:27 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead Jul 06 12:39:27 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:27 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.828s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:27 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Deleted volume successfully. Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD" returned: 1 in 0.947s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] 49192ccd-2851-412b-878b-795194eb3077 was raw, converting to raw {{(pid=86561) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c7e5ba8-202c-418f-9083-e17987198854 tempest-VolumeDependencyTests-290930597 None] Lock "cinder-0ffdf811-b3e7-4215-92ce-635803f3a213-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:27 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 Jul 06 12:39:27 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:28 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354" returned: 0 in 0.984s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:28 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:28 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354 Jul 06 12:39:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead" returned: 0 in 1.021s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:28 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:28 devstack cinder-volume[86561]: DEBUG cinder.utils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Path /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a not found in is_blk_device check {{(pid=86561) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 12:39:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:28 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a Jul 06 12:39:28 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:28 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8" returned: 0 in 1.044s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:28 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_49192ccd-2851-412b-878b-795194eb3077_egzyoq9cdevstack@QuobyteHD, size 0.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:39:28 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 12:39:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:28 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 1G Jul 06 12:39:28 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:28 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-293389fd-87f2-44d4-8183-c402da1be354" returned: 0 in 0.837s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Lock "cinder-quobyte-293389fd-87f2-44d4-8183-c402da1be354" released by "delete_volume" :: held 1.899s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:29 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Created reservations ['a39a1072-d002-4f86-bd0d-7699a8dedae0', '2154899a-d140-4510-8fb8-e8e6450a0dea', '27275af0-178f-4989-8018-a7a2eff3ffd1', 'a4581973-7b3b-46d6-aa34-a45297b46221'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:29 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:39:29 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:29 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 1G" returned: 0 in 1.368s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[45690010-78db-49a5-919e-335aec7b79c4]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:30 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 Jul 06 12:39:30 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:31 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.935s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:31 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:31 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Deleted volume successfully. Jul 06 12:39:31 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-32593d6a-cadb-4a6b-a695-0e64423b759a tempest-ProjectReaderTests-1964193583 None] Lock "cinder-293389fd-87f2-44d4-8183-c402da1be354-delete_volume" released by "delete_volume" :: held 4.176s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:32 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8" returned: 0 in 2.181s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:32 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 Jul 06 12:39:32 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:39:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:32 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:39:33 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:34 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8" returned: 1 in 2.536s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:39:34 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Downloaded image 49192ccd-2851-412b-878b-795194eb3077 ((None, [{'url': 'file:///opt/stack/data/glance/images/49192ccd-2851-412b-878b-795194eb3077', 'metadata': {}}])) to volume b380e5d7-77c1-43a9-9b5e-fc9079d059a8 successfully. {{(pid=86561) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 12:39:34 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Temporary image 49192ccd-2851-412b-878b-795194eb3077 for user d45bc4f014e9461bb208ff2c31c8428a is deleted. {{(pid=86561) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 12:39:34 devstack cinder-volume[86561]: DEBUG cinder.volume.volume_utils [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Marking volume b380e5d7-77c1-43a9-9b5e-fc9079d059a8 as bootable. {{(pid=86561) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 12:39:34 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Copying metadata from image 49192ccd-2851-412b-878b-795194eb3077 to b380e5d7-77c1-43a9-9b5e-fc9079d059a8. {{(pid=86561) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 12:39:34 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Creating volume glance metadata for volume b380e5d7-77c1-43a9-9b5e-fc9079d059a8 backed by image 49192ccd-2851-412b-878b-795194eb3077 with: {'image_id': '49192ccd-2851-412b-878b-795194eb3077', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '33392f973f8bb0b4f95de83aec36156c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86561) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07869dd-bead-4973-a713-c58d137648b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8', 'volume_size': 1, 'image_id': '49192ccd-2851-412b-878b-795194eb3077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/49192ccd-2851-412b-878b-795194eb3077', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33392f973f8bb0b4f95de83aec36156c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '27d22205e0d4449a9a607b9e068f7a1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c5140389e622845143ee25e976707881c75150d27a029bda67dde54e85b6be4fbca71aff92c67933d70007c74bb6e437c1db4046178f9de03c710447c89c5c87', 'id': '49192ccd-2851-412b-878b-795194eb3077', 'created_at': datetime.datetime(2026, 7, 6, 10, 39, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 10, 39, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/49192ccd-2851-412b-878b-795194eb3077/file', 'properties': {}}, 'image_service': }' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6441a083-98db-464b-b93e-a15b9a5f9a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Volume volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 (b380e5d7-77c1-43a9-9b5e-fc9079d059a8): created successfully Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6441a083-98db-464b-b93e-a15b9a5f9a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Flow 'volume_create_manager' (55c0f15d-5421-412f-a49c-bc102dbaf3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:35 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3ad8f723-d8ed-4d91-85e5-e2e4adc354f1 tempest-VolumeImageDependencyTests-431515534 None] Created volume successfully. Jul 06 12:39:35 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 2.539s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Flow 'volume_create_manager' (6ccaf48a-145c-4c98-a70b-83a63e8566fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e2b78a-ff0c-4597-a169-5a8f66cf1d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e2b78a-ff0c-4597-a169-5a8f66cf1d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e99d3e-032c-4fe7-9d13-6df48e2985c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffde7470571e489ab6c828cf74ef8528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:36Z,use_quota=True,user_id='fe2e708f643c406cb234caa46530c1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b8a5bb-3db4-4233-9e55-6a8d6e9dadcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b8a5bb-3db4-4233-9e55-6a8d6e9dadcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c290aad3-0951-453e-8910-badeb285a498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c290aad3-0951-453e-8910-badeb285a498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5e99d3e-032c-4fe7-9d13-6df48e2985c3', 'volume_name': 'volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d68b4e-f129-4dc2-b563-8f4c12a8ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d68b4e-f129-4dc2-b563-8f4c12a8ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fddb6c4-9e1c-427c-bc23-451cd4c58f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Volume e5e99d3e-032c-4fe7-9d13-6df48e2985c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3', 'volume_size': 1} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:35 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" returned: 0 in 7.694s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[874fcee7-0cbc-4894-961e-ab2a58a5a8f5]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:36 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead Jul 06 12:39:36 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Acquiring lock "cinder-b380e5d7-77c1-43a9-9b5e-fc9079d059a8-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Lock "cinder-b380e5d7-77c1-43a9-9b5e-fc9079d059a8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Acquiring lock "cinder-quobyte-b380e5d7-77c1-43a9-9b5e-fc9079d059a8" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Lock "cinder-quobyte-b380e5d7-77c1-43a9-9b5e-fc9079d059a8" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cf835a-b113-454e-b0e3-6c2721688bbc]: (4, 'raw') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:36 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 Jul 06 12:39:36 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:37 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead" returned: 0 in 1.111s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.image.image_utils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Image conversion details: src /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead, size 1024.00 MB, duration 7.70 sec, destination /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a {{(pid=86561) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 12:39:37 devstack cinder-volume[86561]: INFO cinder.image.image_utils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Converted 1024.00 MB image at 133.07 MB/s Jul 06 12:39:37 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a is being set with open permissions: ugo+rw Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:37 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a Jul 06 12:39:37 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:37 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8" returned: 0 in 0.886s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:37 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 Jul 06 12:39:37 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:37 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" returned: 0 in 0.681s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" released by "_copy_volume_from_snapshot" :: held 11.612s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-d55f45d4-10d4-4d7d-acec-3b540bf2b830-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" released by "_create_volume_from_snapshot" :: held 11.679s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.728s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.843s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e99d3e-032c-4fe7-9d13-6df48e2985c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffde7470571e489ab6c828cf74ef8528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:36Z,use_quota=True,user_id='fe2e708f643c406cb234caa46530c1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Creating volume e5e99d3e-032c-4fe7-9d13-6df48e2985c3 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:39:37 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:37 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3 1073741824 Jul 06 12:39:37 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea9c0b2-0a2f-4f41-aec2-ef477a4ac074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a', 'volume_size': 1, 'snapshot_id': 'd55f45d4-10d4-4d7d-acec-3b540bf2b830'}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478ed589-0093-46e2-8be1-ca40fef18e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:37 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Volume volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a (45254ba6-a4e1-40ca-afb0-ec0e373a0a8a): created successfully Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478ed589-0093-46e2-8be1-ca40fef18e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Flow 'volume_create_manager' (94d88618-9d97-4c15-9709-c9abf6a7ff51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:37 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c0931699-841f-43aa-9659-b846f3e34076 tempest-SnapshotDependencyTests-692247165 None] Created volume successfully. Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Flow 'volume_create_manager' (170edb5e-6022-4364-94df-10d289ce2440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d7cda0-5788-4250-ba01-5e9fb9ce94dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d7cda0-5788-4250-ba01-5e9fb9ce94dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-876540903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38428962-431d-4d45-812f-cfc0ebdaef79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879d20aab19c4d2597507fc1d57c4b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:38Z,use_quota=True,user_id='497f2a685f5e4e26941b6c9dec36100e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98d2e35-5992-4c80-adf8-9f867985b836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98d2e35-5992-4c80-adf8-9f867985b836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9acb7c5-7b39-4a37-a810-82390ebd5333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:37 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9acb7c5-7b39-4a37-a810-82390ebd5333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38428962-431d-4d45-812f-cfc0ebdaef79', 'volume_name': 'volume-38428962-431d-4d45-812f-cfc0ebdaef79', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b726e6-4eb2-4342-b850-dba572b98ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b726e6-4eb2-4342-b850-dba572b98ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913dd07b-b209-48a2-9fc8-0fd5286fa949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:38 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Volume 38428962-431d-4d45-812f-cfc0ebdaef79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38428962-431d-4d45-812f-cfc0ebdaef79', 'volume_size': 1} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "cinder-d55f45d4-10d4-4d7d-acec-3b540bf2b830-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-d55f45d4-10d4-4d7d-acec-3b540bf2b830-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "cinder-quobyte-d71c9e02-4af0-431d-8e93-8048db186ead" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-d71c9e02-4af0-431d-8e93-8048db186ead" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "cinder-quobyte-d55f45d4-10d4-4d7d-acec-3b540bf2b830" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-d55f45d4-10d4-4d7d-acec-3b540bf2b830" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:38 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Deleting offline snapshot d55f45d4-10d4-4d7d-acec-3b540bf2b830 of volume d71c9e02-4af0-431d-8e93-8048db186ead {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] snapshot_file for this snap is: volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8" returned: 1 in 1.037s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8' failed. Not Retrying. {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[267131ce-c140-4e7c-aa5b-7a681f163747]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:38 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8 Jul 06 12:39:38 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:38 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 Jul 06 12:39:38 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:38 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3 1073741824" returned: 0 in 1.122s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:38 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:38 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3 Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-b380e5d7-77c1-43a9-9b5e-fc9079d059a8" returned: 0 in 0.722s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:38 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Lock "cinder-quobyte-b380e5d7-77c1-43a9-9b5e-fc9079d059a8" released by "delete_volume" :: held 2.715s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Created reservations ['00ce0945-4fc0-443c-b74d-3ba7d5730b0e', 'c727f0c7-2eef-4258-94d6-e9739495954e', '052ec37f-46fd-4de7-ac4c-659824c2a639', '581e25f1-1f28-40af-8112-1323638927c0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:39 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:39:39 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:39 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830" returned: 0 in 0.949s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d71c9e02-4af0-431d-8e93-8048db186ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc34986c-3143-4c03-95f4-adcf092aadf6]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:39 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead Jul 06 12:39:39 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:39 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3" returned: 0 in 0.869s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.773s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-876540903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38428962-431d-4d45-812f-cfc0ebdaef79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879d20aab19c4d2597507fc1d57c4b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:38Z,use_quota=True,user_id='497f2a685f5e4e26941b6c9dec36100e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Creating volume 38428962-431d-4d45-812f-cfc0ebdaef79 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:39:39 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fddb6c4-9e1c-427c-bc23-451cd4c58f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:39 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79 1073741824 Jul 06 12:39:39 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc8075d-fdf4-4dc5-85f6-bf3dc2b6ac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:39 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Volume volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3 (e5e99d3e-032c-4fe7-9d13-6df48e2985c3): created successfully Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc8075d-fdf4-4dc5-85f6-bf3dc2b6ac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Flow 'volume_create_manager' (6ccaf48a-145c-4c98-a70b-83a63e8566fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-49b656b1-40f1-412c-84ce-cd74de03331f tempest-CinderUnicodeTest-284151982 None] Created volume successfully. Jul 06 12:39:39 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.851s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Deleted volume successfully. Jul 06 12:39:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1c9a36c1-15ad-4639-ae43-b4715a66408b tempest-VolumeImageDependencyTests-431515534 None] Lock "cinder-b380e5d7-77c1-43a9-9b5e-fc9079d059a8-delete_volume" released by "delete_volume" :: held 3.807s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:40 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead" returned: 0 in 0.997s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:40 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 Jul 06 12:39:40 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:40 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79 1073741824" returned: 0 in 1.056s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:40 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79 Jul 06 12:39:40 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:41 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830" returned: 0 in 0.918s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:41 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830 Jul 06 12:39:41 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Flow 'volume_create_manager' (9589fe32-fc19-43e3-80ee-1311dcdffa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a3e367-5236-4c92-837b-538f1381ffc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a3e367-5236-4c92-837b-538f1381ffc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1349752632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a5aa45-a175-4356-84a6-1dd901dcf0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffde7470571e489ab6c828cf74ef8528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:42Z,use_quota=True,user_id='fe2e708f643c406cb234caa46530c1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5830d08a-4cdb-4bc9-b6be-8ba778947180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5830d08a-4cdb-4bc9-b6be-8ba778947180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff03893-8203-4c64-b750-4ae090b1ca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff03893-8203-4c64-b750-4ae090b1ca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a5aa45-a175-4356-84a6-1dd901dcf0a0', 'volume_name': 'volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749994ba-c910-440a-a8fd-ed20f348a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749994ba-c910-440a-a8fd-ed20f348a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775053d7-d99c-4b2f-a574-93b6a4fad4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:42 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Volume a1a5aa45-a175-4356-84a6-1dd901dcf0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0', 'volume_size': 1} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:42 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79" returned: 0 in 1.122s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1349752632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a5aa45-a175-4356-84a6-1dd901dcf0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffde7470571e489ab6c828cf74ef8528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:42Z,use_quota=True,user_id='fe2e708f643c406cb234caa46530c1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Creating volume a1a5aa45-a175-4356-84a6-1dd901dcf0a0 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:39:42 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913dd07b-b209-48a2-9fc8-0fd5286fa949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38428962-431d-4d45-812f-cfc0ebdaef79', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:42 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 1073741824 Jul 06 12:39:42 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1500dc6d-3bfd-4bc2-828f-dbee3408fcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:42 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Volume volume-38428962-431d-4d45-812f-cfc0ebdaef79 (38428962-431d-4d45-812f-cfc0ebdaef79): created successfully Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1500dc6d-3bfd-4bc2-828f-dbee3408fcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Flow 'volume_create_manager' (170edb5e-6022-4364-94df-10d289ce2440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-90ea1cbb-d25a-4532-a27d-9225cdecb1c2 tempest-ProjectReaderTests-1190130795 None] Created volume successfully. Jul 06 12:39:42 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead.d55f45d4-10d4-4d7d-acec-3b540bf2b830" returned: 0 in 1.038s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-d55f45d4-10d4-4d7d-acec-3b540bf2b830" released by "_delete_snapshot" :: held 4.037s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-d71c9e02-4af0-431d-8e93-8048db186ead" released by "delete_snapshot" :: held 4.064s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Created reservations ['0b65a129-2752-41ed-86d1-8481161d77a9', '5d5db598-8119-424b-8d6d-66e9d68f4e84', 'aa15a0d7-57eb-490e-84be-2f7d834cec72', '09741628-1ed6-4fa6-9745-c1fed4528678'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Delete snapshot completed successfully. Jul 06 12:39:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-721e5e61-d2a7-40ae-a5dd-637d378f25ac tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-d55f45d4-10d4-4d7d-acec-3b540bf2b830-delete_snapshot" released by "delete_snapshot" :: held 4.235s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:43 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 1073741824" returned: 0 in 0.998s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:43 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 Jul 06 12:39:43 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "cinder-d71c9e02-4af0-431d-8e93-8048db186ead-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-d71c9e02-4af0-431d-8e93-8048db186ead-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "cinder-quobyte-d71c9e02-4af0-431d-8e93-8048db186ead" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-d71c9e02-4af0-431d-8e93-8048db186ead" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fb3181-afaf-4343-8997-8ac84172b12f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Acquiring lock "cinder-38428962-431d-4d45-812f-cfc0ebdaef79-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Lock "cinder-38428962-431d-4d45-812f-cfc0ebdaef79-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Acquiring lock "cinder-quobyte-38428962-431d-4d45-812f-cfc0ebdaef79" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Lock "cinder-quobyte-38428962-431d-4d45-812f-cfc0ebdaef79" acquired by "delete_volume" :: waited 0.043s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:43 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead Jul 06 12:39:43 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[617a8fc2-a410-4db3-866a-de63e26b9851]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:44 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0" returned: 0 in 0.955s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775053d7-d99c-4b2f-a574-93b6a4fad4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4129434b-e961-43b9-8376-2868c690bdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:44 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79 Jul 06 12:39:44 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:44 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Volume volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 (a1a5aa45-a175-4356-84a6-1dd901dcf0a0): created successfully Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4129434b-e961-43b9-8376-2868c690bdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Flow 'volume_create_manager' (9589fe32-fc19-43e3-80ee-1311dcdffa88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b71a713d-d3b1-47ef-b664-658630ca59ef tempest-CinderUnicodeTest-284151982 None] Created volume successfully. Jul 06 12:39:44 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead" returned: 0 in 1.009s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:44 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead Jul 06 12:39:44 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (709e1224-f3f7-4d65-994a-62ed828e9e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf60504-bcc5-45d2-9fbd-1849747ae9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf60504-bcc5-45d2-9fbd-1849747ae9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227060218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf8efd3-0417-4c0a-bd95-76eb38b0850b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:45Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5e1a74-b61c-4174-826c-a2058138b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5e1a74-b61c-4174-826c-a2058138b07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3b8e5e-37e5-4c8f-8cb9-a1163fa0a949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3b8e5e-37e5-4c8f-8cb9-a1163fa0a949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf8efd3-0417-4c0a-bd95-76eb38b0850b', 'volume_name': 'volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae00619b-787d-43d0-a3a8-15a21b1be57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae00619b-787d-43d0-a3a8-15a21b1be57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316a37df-4384-4ae0-b74a-55c3da3c0893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:44 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Volume 6bf8efd3-0417-4c0a-bd95-76eb38b0850b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b', 'volume_size': 1} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-227060218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf8efd3-0417-4c0a-bd95-76eb38b0850b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:45Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Creating volume 6bf8efd3-0417-4c0a-bd95-76eb38b0850b {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:39:44 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:44 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79" returned: 0 in 0.952s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:44 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b 1073741824 Jul 06 12:39:44 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:44 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79 Jul 06 12:39:44 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:45 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d71c9e02-4af0-431d-8e93-8048db186ead" returned: 0 in 0.855s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-d71c9e02-4af0-431d-8e93-8048db186ead" released by "delete_volume" :: held 1.975s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Created reservations ['5718a481-558b-456d-bf0a-e5e876120456', '3895140a-750b-4403-9cbb-71aa1d4ab82d', '6a6e28b9-262f-4333-b77f-ce0039699eb8', '6a94be03-1b21-445a-993e-2e156cbfaccc'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:45 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38428962-431d-4d45-812f-cfc0ebdaef79" returned: 0 in 0.916s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:45 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:39:45 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Lock "cinder-quobyte-38428962-431d-4d45-812f-cfc0ebdaef79" released by "delete_volume" :: held 1.929s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "cinder-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Created reservations ['894933cc-4fd3-4d1e-bbdb-fc69e252c3c9', '00dd5f6a-321a-41eb-9e9f-c6bdce917079', 'fa929748-cc3b-4388-ac69-6f21f637c7cc', '85dec166-e9e9-4dfb-89ab-bc4ab0b7ffa0'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "cinder-quobyte-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d236b5ee-7fb4-41f3-b117-e707929f8d21]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:46 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b 1073741824" returned: 0 in 1.199s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:46 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:39:46 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:46 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a Jul 06 12:39:46 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:46 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b Jul 06 12:39:46 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=107,cinder:INSERT=35,cinder:UPDATE=165,cinder:DELETE=19 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=118,cinder:INSERT=45,cinder:UPDATE=135,cinder:DELETE=4 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Flow 'volume_create_manager' (d3298e42-a7ae-4ca2-a251-fc745160c6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dde9b34-b738-4864-ab6f-7b55fe326d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dde9b34-b738-4864-ab6f-7b55fe326d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1413273433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879d20aab19c4d2597507fc1d57c4b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:47Z,use_quota=True,user_id='497f2a685f5e4e26941b6c9dec36100e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cb0b37-ef39-46af-b4ae-d5c108f927d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:46 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cb0b37-ef39-46af-b4ae-d5c108f927d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6de84b-d440-45b5-9979-6b142e5d7e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6de84b-d440-45b5-9979-6b142e5d7e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83', 'volume_name': 'volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5069d4-dabe-4fb9-8846-d92d1d5f813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5069d4-dabe-4fb9-8846-d92d1d5f813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a198a6ae-c9b9-4a6f-b577-ab30cd8cdcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:47 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Volume 7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83', 'volume_size': 1} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:47 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.315s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Deleted volume successfully. Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-3969a50e-5f1d-4b75-b0d7-345fad4e9dbb tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-d71c9e02-4af0-431d-8e93-8048db186ead-delete_volume" released by "delete_volume" :: held 3.605s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:47 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.051s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Deleted volume successfully. Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-131a1cfd-1b0b-4643-90b2-78924f237485 tempest-ProjectReaderTests-1190130795 None] Lock "cinder-38428962-431d-4d45-812f-cfc0ebdaef79-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:47 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" returned: 0 in 1.296s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:47 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a Jul 06 12:39:47 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:47 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b" returned: 0 in 1.201s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] <== create_volume: return (2500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.503s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.959s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316a37df-4384-4ae0-b74a-55c3da3c0893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b3c7e1-3983-4752-a857-daaaca256e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] Creating offline snapshot ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 of volume a1a5aa45-a175-4356-84a6-1dd901dcf0a0 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:39:47 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Volume volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b (6bf8efd3-0417-4c0a-bd95-76eb38b0850b): created successfully Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b3c7e1-3983-4752-a857-daaaca256e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (709e1224-f3f7-4d65-994a-62ed828e9e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[addbb373-5c8d-44fd-8cf8-4bcfd051b585]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-deec6c94-0577-41af-9c9a-244fc86d8d21 tempest-ProjectMemberTests-1109497705 None] Created volume successfully. Jul 06 12:39:47 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 Jul 06 12:39:47 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:48 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" returned: 0 in 0.880s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-quobyte-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a" released by "delete_volume" :: held 2.233s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Created reservations ['277a2cd2-b2a0-458f-8d03-17bfffcade8c', 'b6b47a1f-9189-4695-a50d-47459911f98e', '97ebbe6e-fe46-4659-a6a1-2e3659405a83', 'df95cc99-9f99-41d1-94a6-8a19635758b1'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:48 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0" returned: 0 in 0.913s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:48 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 1G Jul 06 12:39:48 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:48 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:39:48 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:49 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.730s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:49 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Deleted volume successfully. Jul 06 12:39:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-d10d8cd0-eb17-4ca0-8d44-d6836cca97f7 tempest-SnapshotDependencyTests-692247165 None] Lock "cinder-45254ba6-a4e1-40ca-afb0-ec0e373a0a8a-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:49 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 1G" returned: 0 in 0.942s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:49 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 Jul 06 12:39:49 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:50 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04" returned: 0 in 0.759s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:50 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 is being set with open permissions: ugo+rw Jul 06 12:39:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:50 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 Jul 06 12:39:50 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:50 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04" returned: 0 in 0.716s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:50 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.info Jul 06 12:39:50 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:51 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.info" returned: 0 in 0.681s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:51 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.info is being set with open permissions: ugo+rw Jul 06 12:39:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:51 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.info Jul 06 12:39:51 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:52 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.info" returned: 0 in 0.777s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.985s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.343s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1413273433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879d20aab19c4d2597507fc1d57c4b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:47Z,use_quota=True,user_id='497f2a685f5e4e26941b6c9dec36100e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Creating volume 7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:39:52 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:52 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83 1073741824 Jul 06 12:39:52 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:52 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6bacdd8a-f838-45c7-b1d6-e8d755ac98cf tempest-CinderUnicodeTest-284151982 None] Create snapshot completed successfully Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Acquiring lock "cinder-ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Lock "cinder-ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Acquiring lock "cinder-quobyte-a1a5aa45-a175-4356-84a6-1dd901dcf0a0" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Lock "cinder-quobyte-a1a5aa45-a175-4356-84a6-1dd901dcf0a0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Acquiring lock "cinder-quobyte-ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Lock "cinder-quobyte-ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Deleting offline snapshot ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 of volume a1a5aa45-a175-4356-84a6-1dd901dcf0a0 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] snapshot_file for this snap is: volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[32540162-cf83-4c8f-ae10-5aabf720ae8f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:53 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 Jul 06 12:39:53 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:53 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83 1073741824" returned: 0 in 1.306s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:53 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83 Jul 06 12:39:53 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:53 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04" returned: 0 in 1.078s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:53 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ebb321-51b8-4d8e-95cf-1fca5b8c4cbf]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:54 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 Jul 06 12:39:54 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:54 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83" returned: 0 in 0.752s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.126s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a198a6ae-c9b9-4a6f-b577-ab30cd8cdcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d60755-9a8d-437e-a6f1-3a65f026ed45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] Creating offline snapshot 7cd86879-1b1a-40e3-bced-59c3f7126afc of volume 6bf8efd3-0417-4c0a-bd95-76eb38b0850b {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:39:54 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Volume volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83 (7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83): created successfully Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d60755-9a8d-437e-a6f1-3a65f026ed45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Flow 'volume_create_manager' (d3298e42-a7ae-4ca2-a251-fc745160c6cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d4e593-5463-493b-984a-ead62315cc63]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-50f149a6-275e-4819-96d9-6966d3424d54 tempest-ProjectReaderTests-1190130795 None] Created volume successfully. Jul 06 12:39:54 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b Jul 06 12:39:54 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:55 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0" returned: 0 in 0.994s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:55 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 Jul 06 12:39:55 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Acquiring lock "cinder-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Lock "cinder-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Acquiring lock "cinder-quobyte-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Lock "cinder-quobyte-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83" acquired by "delete_volume" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:55 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b" returned: 0 in 1.129s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:55 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ea0fd5-95ec-4645-9408-6e9121fdad87]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:55 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc 1G Jul 06 12:39:55 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:55 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83 Jul 06 12:39:55 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:56 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04" returned: 0 in 1.070s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:56 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04 Jul 06 12:39:56 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:56 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83" returned: 0 in 0.873s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:56 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83 Jul 06 12:39:56 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:56 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc 1G" returned: 0 in 1.128s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:56 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc Jul 06 12:39:56 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:56 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0.ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04" returned: 0 in 0.880s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Lock "cinder-quobyte-ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04" released by "_delete_snapshot" :: held 4.174s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Lock "cinder-quobyte-a1a5aa45-a175-4356-84a6-1dd901dcf0a0" released by "delete_snapshot" :: held 4.215s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Created reservations ['fc76ca29-1468-4228-8678-9d89aa8c3ec9', '1343ce1f-3006-4272-9f50-9aa3010a9475', '4fb4cb0e-3bbd-4907-9204-383999097311', '4f42c5a8-b8b9-48dd-a8be-a47ec045d972'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Delete snapshot completed successfully. Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-909c083a-a384-4ae5-bd4c-f5ba6d3dc11e tempest-CinderUnicodeTest-284151982 None] Lock "cinder-ee9ba94d-94d3-4299-92d0-4f2e4eb0fb04-delete_snapshot" released by "delete_snapshot" :: held 4.453s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:57 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83" returned: 0 in 0.956s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Lock "cinder-quobyte-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83" released by "delete_volume" :: held 1.917s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Created reservations ['58bd968b-4897-4b48-bcb3-35afcf214838', '3bbe562a-3dc3-497c-af05-9f997f712e3c', '461bb94f-5dbd-4d0c-ac65-c2f242aa70ef', '3bf4436b-8548-4d48-98e8-be0dd2e71a79'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:39:57 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc" returned: 0 in 0.907s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:57 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc is being set with open permissions: ugo+rw Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:39:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:57 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc Jul 06 12:39:57 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:57 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:39:57 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Acquiring lock "cinder-a1a5aa45-a175-4356-84a6-1dd901dcf0a0-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Lock "cinder-a1a5aa45-a175-4356-84a6-1dd901dcf0a0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Acquiring lock "cinder-quobyte-a1a5aa45-a175-4356-84a6-1dd901dcf0a0" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Lock "cinder-quobyte-a1a5aa45-a175-4356-84a6-1dd901dcf0a0" acquired by "delete_volume" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[855ee32b-97bb-4781-99b3-9b5882d427bd]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:39:58 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 Jul 06 12:39:58 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Flow 'volume_create_manager' (55205395-64eb-4234-a9b9-ea8cc6fdb4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4af389d-31bc-4ee7-8938-76c1a3826d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4af389d-31bc-4ee7-8938-76c1a3826d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510251329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1a744c-b273-449b-845e-cb7b2b18af7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879d20aab19c4d2597507fc1d57c4b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:59Z,use_quota=True,user_id='497f2a685f5e4e26941b6c9dec36100e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c440e0aa-e1d6-44a9-9f7b-2d4b174f53a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c440e0aa-e1d6-44a9-9f7b-2d4b174f53a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cef6299-8bba-4cc8-9054-e6f34e99199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:58 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cef6299-8bba-4cc8-9054-e6f34e99199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1a744c-b273-449b-845e-cb7b2b18af7c', 'volume_name': 'volume-3f1a744c-b273-449b-845e-cb7b2b18af7c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78544962-8485-429d-900f-d63be37ccae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78544962-8485-429d-900f-d63be37ccae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf40afe-ee69-49ac-ab62-a36b7ceb4812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:39:58 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Volume 3f1a744c-b273-449b-845e-cb7b2b18af7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1a744c-b273-449b-845e-cb7b2b18af7c', 'volume_size': 1} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:39:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc" returned: 0 in 1.169s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:59 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 1.191s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:59 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:39:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Deleted volume successfully. Jul 06 12:39:59 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.info Jul 06 12:39:59 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:59 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c6ef0191-87e4-4cdc-bc3b-dcc6fc06ad66 tempest-ProjectReaderTests-1190130795 None] Lock "cinder-7e3ee7b0-1ec1-4fb3-8ad9-32661841ce83-delete_volume" released by "delete_volume" :: held 3.444s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:39:59 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0" returned: 0 in 1.186s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:59 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 06 12:39:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.info" returned: 0 in 0.736s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:39:59 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.info is being set with open permissions: ugo+rw Jul 06 12:39:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:39:59 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0 Jul 06 12:39:59 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:39:59 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.info Jul 06 12:39:59 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:00 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-a1a5aa45-a175-4356-84a6-1dd901dcf0a0" returned: 0 in 0.720s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Lock "cinder-quobyte-a1a5aa45-a175-4356-84a6-1dd901dcf0a0" released by "delete_volume" :: held 2.036s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:00 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.info" returned: 0 in 0.783s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.036s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.586s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510251329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1a744c-b273-449b-845e-cb7b2b18af7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879d20aab19c4d2597507fc1d57c4b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:39:59Z,use_quota=True,user_id='497f2a685f5e4e26941b6c9dec36100e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Creating volume 3f1a744c-b273-449b-845e-cb7b2b18af7c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:00 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Created reservations ['25fdb83d-60ed-43a8-86a6-3229f66785d7', 'eb3baa0a-1a1e-49ef-8ba1-6411acc7f1f6', '195c46b3-e0e7-47ff-8278-3fa8d47b2185', 'c6e28a99-a42d-4bd3-bde9-e1693b18a623'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:00 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c 1073741824 Jul 06 12:40:00 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:00 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3596915e-4207-4e50-a994-111cf8d9998c tempest-ProjectMemberTests-1109497705 None] Create snapshot completed successfully Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:00 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:40:00 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-7cd86879-1b1a-40e3-bced-59c3f7126afc-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Lock "cinder-7cd86879-1b1a-40e3-bced-59c3f7126afc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-6bf8efd3-0417-4c0a-bd95-76eb38b0850b" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-6bf8efd3-0417-4c0a-bd95-76eb38b0850b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-7cd86879-1b1a-40e3-bced-59c3f7126afc" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-7cd86879-1b1a-40e3-bced-59c3f7126afc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Deleting offline snapshot 7cd86879-1b1a-40e3-bced-59c3f7126afc of volume 6bf8efd3-0417-4c0a-bd95-76eb38b0850b {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] snapshot_file for this snap is: volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9630140-25d7-4bf4-a04b-994cc6fb31c8]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:01 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc Jul 06 12:40:01 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:01 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.799s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Deleted volume successfully. Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-280e1ace-4eff-46e9-b5fe-152c8a6312b9 tempest-CinderUnicodeTest-284151982 None] Lock "cinder-a1a5aa45-a175-4356-84a6-1dd901dcf0a0-delete_volume" released by "delete_volume" :: held 3.316s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Acquiring lock "cinder-e5e99d3e-032c-4fe7-9d13-6df48e2985c3-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Lock "cinder-e5e99d3e-032c-4fe7-9d13-6df48e2985c3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Acquiring lock "cinder-quobyte-e5e99d3e-032c-4fe7-9d13-6df48e2985c3" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Lock "cinder-quobyte-e5e99d3e-032c-4fe7-9d13-6df48e2985c3" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:01 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c 1073741824" returned: 0 in 1.203s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[496ce771-16f6-4958-97b3-5450fb7d3a07]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:01 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c Jul 06 12:40:01 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:01 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3 Jul 06 12:40:01 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:02 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc" returned: 0 in 0.959s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba087aa0-5089-4c37-8680-12991483c4cd]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:02 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b Jul 06 12:40:02 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:02 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c" returned: 0 in 0.675s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf40afe-ee69-49ac-ab62-a36b7ceb4812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1a744c-b273-449b-845e-cb7b2b18af7c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcceea5e-0dec-4163-b149-3652192e35dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:02 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Volume volume-3f1a744c-b273-449b-845e-cb7b2b18af7c (3f1a744c-b273-449b-845e-cb7b2b18af7c): created successfully Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcceea5e-0dec-4163-b149-3652192e35dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Flow 'volume_create_manager' (55205395-64eb-4234-a9b9-ea8cc6fdb4db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:02 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-592c97ba-adf2-4e2c-b8d6-284e4472e26f tempest-ProjectReaderTests-1190130795 None] Created volume successfully. Jul 06 12:40:02 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3" returned: 0 in 0.935s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:02 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3 Jul 06 12:40:02 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Acquiring lock "cinder-3f1a744c-b273-449b-845e-cb7b2b18af7c-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Lock "cinder-3f1a744c-b273-449b-845e-cb7b2b18af7c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:03 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b" returned: 0 in 0.828s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:03 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc Jul 06 12:40:03 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Acquiring lock "cinder-quobyte-3f1a744c-b273-449b-845e-cb7b2b18af7c" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Lock "cinder-quobyte-3f1a744c-b273-449b-845e-cb7b2b18af7c" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9eeb0c-b4df-4871-b53d-1e6565485a31]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:03 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c Jul 06 12:40:03 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:03 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-e5e99d3e-032c-4fe7-9d13-6df48e2985c3" returned: 0 in 0.812s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Lock "cinder-quobyte-e5e99d3e-032c-4fe7-9d13-6df48e2985c3" released by "delete_volume" :: held 1.793s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Created reservations ['61f29308-417b-440c-a0df-d3a4cb7f25eb', 'd7c48e66-74a6-4c1d-95c5-ca8116cc5ab1', '21687e47-f5fd-4137-835a-a18196240602', '2e3593fc-53a4-4631-9cfa-25ad4c40e75f'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:03 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:40:03 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:03 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc" returned: 0 in 0.784s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:03 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc Jul 06 12:40:03 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:04 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c" returned: 0 in 0.883s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:04 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c Jul 06 12:40:04 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:04 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.719s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Deleted volume successfully. Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-fcda543d-10e5-4571-9156-ea7bb2b352bf tempest-CinderUnicodeTest-284151982 None] Lock "cinder-e5e99d3e-032c-4fe7-9d13-6df48e2985c3-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:04 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b.7cd86879-1b1a-40e3-bced-59c3f7126afc" returned: 0 in 0.710s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-7cd86879-1b1a-40e3-bced-59c3f7126afc" released by "_delete_snapshot" :: held 3.450s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-6bf8efd3-0417-4c0a-bd95-76eb38b0850b" released by "delete_snapshot" :: held 3.489s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Created reservations ['163ee7a8-e15a-49d2-ba66-9125eaa86c82', 'fe38a5a5-476c-4418-8f56-b0feef07a503', 'b79ed745-603d-4574-87d7-e879d6b1c9c8', '4d85b02e-eedd-4131-a4ff-85b5de9a9977'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Delete snapshot completed successfully. Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c01e83ec-6902-4c6a-bec2-135bc8ab9efd tempest-ProjectMemberTests-1109497705 None] Lock "cinder-7cd86879-1b1a-40e3-bced-59c3f7126afc-delete_snapshot" released by "delete_snapshot" :: held 3.668s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:04 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3f1a744c-b273-449b-845e-cb7b2b18af7c" returned: 0 in 0.784s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Lock "cinder-quobyte-3f1a744c-b273-449b-845e-cb7b2b18af7c" released by "delete_volume" :: held 1.714s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Created reservations ['a071f00c-b8a9-4f4a-8525-d1f3792600dd', 'b3a93ef6-381f-4d9e-af4d-a2c8631e62ff', 'e67b9b88-6a90-419c-8530-1f681e0bed7a', '19b2c740-b481-46ac-955d-e96d16ea4392'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:05 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:40:05 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-6bf8efd3-0417-4c0a-bd95-76eb38b0850b-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-6bf8efd3-0417-4c0a-bd95-76eb38b0850b-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-6bf8efd3-0417-4c0a-bd95-76eb38b0850b" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-6bf8efd3-0417-4c0a-bd95-76eb38b0850b" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a6ef16-b088-4409-b2a7-1e5248cc7a45]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:05 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.888s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:05 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Deleted volume successfully. Jul 06 12:40:05 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b Jul 06 12:40:05 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6c5bf74e-1e74-4db4-a1db-3c3e99aa050f tempest-ProjectReaderTests-1190130795 None] Lock "cinder-3f1a744c-b273-449b-845e-cb7b2b18af7c-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Flow 'volume_create_manager' (44f99b6f-9744-411c-b113-b693dcdf5d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c31b39d-8ca4-4f4a-a581-73ccf31161c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c31b39d-8ca4-4f4a-a581-73ccf31161c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17779500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be68156-5433-4870-8840-85ac52ca9706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879d20aab19c4d2597507fc1d57c4b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:06Z,use_quota=True,user_id='497f2a685f5e4e26941b6c9dec36100e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae094dfc-b6e5-42e7-bb6d-0e5beb30a28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae094dfc-b6e5-42e7-bb6d-0e5beb30a28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb398283-6368-4286-8863-fc5c975850a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb398283-6368-4286-8863-fc5c975850a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be68156-5433-4870-8840-85ac52ca9706', 'volume_name': 'volume-8be68156-5433-4870-8840-85ac52ca9706', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ca8e6a-1a53-4a9e-bc0a-1a50334d0b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ca8e6a-1a53-4a9e-bc0a-1a50334d0b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb6cb6b-6cb6-46b9-94ac-cac3df8938dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:06 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Volume 8be68156-5433-4870-8840-85ac52ca9706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be68156-5433-4870-8840-85ac52ca9706', 'volume_size': 1} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17779500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be68156-5433-4870-8840-85ac52ca9706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879d20aab19c4d2597507fc1d57c4b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:06Z,use_quota=True,user_id='497f2a685f5e4e26941b6c9dec36100e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Creating volume 8be68156-5433-4870-8840-85ac52ca9706 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:06 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:06 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706 1073741824 Jul 06 12:40:06 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:06 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b" returned: 0 in 1.096s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:06 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b Jul 06 12:40:06 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:07 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706 1073741824" returned: 0 in 1.039s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:07 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706 Jul 06 12:40:07 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:07 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-6bf8efd3-0417-4c0a-bd95-76eb38b0850b" returned: 0 in 0.787s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:07 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-6bf8efd3-0417-4c0a-bd95-76eb38b0850b" released by "delete_volume" :: held 2.040s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:07 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Created reservations ['aad6d96e-88c0-45af-b761-da6b214d5862', '4d431ad9-ced1-4b79-a995-3e2a555421dc', '94f0cfc1-cc0b-481a-9dd1-925f8e896168', '7dad2849-1d0f-41b2-8b85-30b07ae81cd7'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:07 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:07 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:40:07 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:08 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706" returned: 0 in 0.776s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb6cb6b-6cb6-46b9-94ac-cac3df8938dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be68156-5433-4870-8840-85ac52ca9706', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cdce5b-f1ff-4257-b150-ac84e8f05fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Volume volume-8be68156-5433-4870-8840-85ac52ca9706 (8be68156-5433-4870-8840-85ac52ca9706): created successfully Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cdce5b-f1ff-4257-b150-ac84e8f05fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Flow 'volume_create_manager' (44f99b6f-9744-411c-b113-b693dcdf5d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1076b3a5-5b04-4e42-b057-d11e708e171e tempest-ProjectReaderTests-1190130795 None] Created volume successfully. Jul 06 12:40:08 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (324f087d-9c9e-45e9-9d2c-8005e8c46df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd74739-8c60-4e3b-8f6c-4b443fa76cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.812s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Deleted volume successfully. Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd74739-8c60-4e3b-8f6c-4b443fa76cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174838290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c37102-71ac-40f2-b9ed-6b76ef7aa9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:09Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b98752a-9423-4d58-adb3-039045b2c90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b98752a-9423-4d58-adb3-039045b2c90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b2a27b-b889-416d-9d97-3815ee5c50c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b2a27b-b889-416d-9d97-3815ee5c50c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c37102-71ac-40f2-b9ed-6b76ef7aa9e2', 'volume_name': 'volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9b7dbb-9c19-4cab-85d0-5c1599be9ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9b7dbb-9c19-4cab-85d0-5c1599be9ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0d1e11-1423-4a64-86f6-c258096670ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:08 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Volume 53c37102-71ac-40f2-b9ed-6b76ef7aa9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2', 'volume_size': 1} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-174838290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c37102-71ac-40f2-b9ed-6b76ef7aa9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:09Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Creating volume 53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:08 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-1195b3e6-be7a-48f8-8f16-20845293ffa2 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-6bf8efd3-0417-4c0a-bd95-76eb38b0850b-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:08 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 1073741824 Jul 06 12:40:08 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (fe6a28ac-b6f6-4856-84aa-ecc00c8632ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621cf76e-17c8-4963-8e3f-76c0a5730e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621cf76e-17c8-4963-8e3f-76c0a5730e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-79874189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cace6f-bb3b-465a-86d7-b3d20fd415df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:09Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbd6432-3c47-4252-a41b-1146b3815d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbd6432-3c47-4252-a41b-1146b3815d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41551ed5-9515-4d60-ac26-609d057d9493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41551ed5-9515-4d60-ac26-609d057d9493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1cace6f-bb3b-465a-86d7-b3d20fd415df', 'volume_name': 'volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3801f1-4bd1-441c-9ac6-83e422c2f958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3801f1-4bd1-441c-9ac6-83e422c2f958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0ab4e0-2607-4f68-8c40-09063d732242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:09 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Volume d1cace6f-bb3b-465a-86d7-b3d20fd415df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df', 'volume_size': 1} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Acquiring lock "cinder-8be68156-5433-4870-8840-85ac52ca9706-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Lock "cinder-8be68156-5433-4870-8840-85ac52ca9706-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Acquiring lock "cinder-quobyte-8be68156-5433-4870-8840-85ac52ca9706" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Lock "cinder-quobyte-8be68156-5433-4870-8840-85ac52ca9706" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[45933927-5e1b-48c7-8123-9f8486d2b1ae]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:09 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 1073741824" returned: 0 in 0.952s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:09 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706 Jul 06 12:40:09 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:09 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 Jul 06 12:40:09 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:10 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2" returned: 0 in 0.701s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-79874189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cace6f-bb3b-465a-86d7-b3d20fd415df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:09Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Creating volume d1cace6f-bb3b-465a-86d7-b3d20fd415df {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:10 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:10 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706" returned: 0 in 0.853s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:10 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df 1073741824 Jul 06 12:40:10 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0d1e11-1423-4a64-86f6-c258096670ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:10 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706 Jul 06 12:40:10 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50118401-9187-46fe-8fe4-91f179e620ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:10 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Volume volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 (53c37102-71ac-40f2-b9ed-6b76ef7aa9e2): created successfully Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50118401-9187-46fe-8fe4-91f179e620ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (324f087d-9c9e-45e9-9d2c-8005e8c46df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ea943c21-f51f-4163-a838-2a1a75dda75d tempest-ProjectReaderTests-189174883 None] Created volume successfully. Jul 06 12:40:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:11 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-8be68156-5433-4870-8840-85ac52ca9706" returned: 0 in 0.701s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Lock "cinder-quobyte-8be68156-5433-4870-8840-85ac52ca9706" released by "delete_volume" :: held 1.596s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:11 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:11 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Created reservations ['684b5fb2-6725-417d-9c2f-6b26af04a67b', '0f74be80-577e-463b-a193-8a62e78908d4', '6152ee3c-ac95-4daa-9662-964e7880ccc7', '95d80400-5c6e-421c-b859-902b33ac78c4'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df 1073741824" returned: 0 in 0.942s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:11 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df Jul 06 12:40:11 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:11 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:40:11 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:12 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df" returned: 0 in 0.672s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:40:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.319s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] Creating offline snapshot 5f1d346f-81bd-4add-a18b-3d9b47a7ece8 of volume 53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:40:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a178bc1-d044-42a6-9fe3-cdefa1779750]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:12 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 Jul 06 12:40:12 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:12 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.789s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:12 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Deleted volume successfully. Jul 06 12:40:13 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2" returned: 0 in 0.807s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:13 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 1G Jul 06 12:40:13 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0ab4e0-2607-4f68-8c40-09063d732242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:13 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38043b0b-be65-4faf-8731-872f703a05eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:13 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a8f82960-4497-441a-8923-df8dd6b90a4a tempest-ProjectReaderTests-1190130795 None] Lock "cinder-8be68156-5433-4870-8840-85ac52ca9706-delete_volume" released by "delete_volume" :: held 4.024s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:13 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 1G" returned: 0 in 0.771s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:13 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 Jul 06 12:40:13 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:14 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8" returned: 0 in 0.681s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:14 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 is being set with open permissions: ugo+rw Jul 06 12:40:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:14 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 Jul 06 12:40:14 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:14 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Volume volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df (d1cace6f-bb3b-465a-86d7-b3d20fd415df): created successfully Jul 06 12:40:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38043b0b-be65-4faf-8731-872f703a05eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:14 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (fe6a28ac-b6f6-4856-84aa-ecc00c8632ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:15 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8" returned: 0 in 0.622s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:16 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1e006376-c393-4754-8512-6c0caed0d563 tempest-ProjectMemberTests-1109497705 None] Created volume successfully. Jul 06 12:40:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:16 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.info Jul 06 12:40:16 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:17 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.info" returned: 0 in 0.760s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:17 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.info is being set with open permissions: ugo+rw Jul 06 12:40:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:17 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.info Jul 06 12:40:17 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:17 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.info" returned: 0 in 0.727s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.747s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.045s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] Creating offline snapshot 876ead05-fa07-4e84-9686-2dcadd3119a9 of volume d1cace6f-bb3b-465a-86d7-b3d20fd415df {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:40:18 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9e77ab2d-7564-4806-b5ae-bda6ed139629 tempest-ProjectReaderTests-189174883 None] Create snapshot completed successfully Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[564a7c69-b3a2-4c8b-958a-a920950e3c77]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:18 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df Jul 06 12:40:18 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-5f1d346f-81bd-4add-a18b-3d9b47a7ece8-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Lock "cinder-5f1d346f-81bd-4add-a18b-3d9b47a7ece8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-5f1d346f-81bd-4add-a18b-3d9b47a7ece8" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-5f1d346f-81bd-4add-a18b-3d9b47a7ece8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Deleting offline snapshot 5f1d346f-81bd-4add-a18b-3d9b47a7ece8 of volume 53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] snapshot_file for this snap is: volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[01296372-72ff-498f-847b-1c181be4c30b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:18 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 Jul 06 12:40:18 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:18 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df" returned: 0 in 0.846s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:18 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 1G Jul 06 12:40:18 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:19 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8" returned: 0 in 0.812s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:40:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[190113a0-3221-49d1-94f9-808c41061616]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:19 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 Jul 06 12:40:19 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:19 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 1G" returned: 0 in 0.825s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:19 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 Jul 06 12:40:19 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:20 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2" returned: 0 in 0.819s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:20 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 Jul 06 12:40:20 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:20 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9" returned: 0 in 0.699s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:20 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 is being set with open permissions: ugo+rw Jul 06 12:40:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:20 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 Jul 06 12:40:20 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:21 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8" returned: 0 in 0.775s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:21 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8 Jul 06 12:40:21 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:21 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9" returned: 0 in 0.663s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:21 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.info Jul 06 12:40:21 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:21 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2.5f1d346f-81bd-4add-a18b-3d9b47a7ece8" returned: 0 in 0.633s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-5f1d346f-81bd-4add-a18b-3d9b47a7ece8" released by "_delete_snapshot" :: held 3.157s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2" released by "delete_snapshot" :: held 3.190s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:21 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Created reservations ['3e2b3791-d751-47e5-b489-f8926ae09e70', '5857d5ca-53c5-4110-a523-cae0982ff08f', '2bfb7998-b245-4c61-9026-bf2d99f7f916', 'fdae4110-5eef-41f3-a935-504b910d37e1'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:21 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.info" returned: 0 in 0.701s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:21 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.info is being set with open permissions: ugo+rw Jul 06 12:40:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Delete snapshot completed successfully. Jul 06 12:40:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-276f7d55-5509-45ed-a902-75d3cd1c9d1e tempest-ProjectReaderTests-189174883 None] Lock "cinder-5f1d346f-81bd-4add-a18b-3d9b47a7ece8-delete_snapshot" released by "delete_snapshot" :: held 3.348s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:21 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.info Jul 06 12:40:21 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:22 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.info" returned: 0 in 0.640s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.478s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-25aea043-8981-461e-b271-03ab5710f46a tempest-ProjectMemberTests-1109497705 None] Create snapshot completed successfully Jul 06 12:40:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Lock "cinder-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:22 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4ad5f9-ea5d-443e-ba50-b3ea701da9aa]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:23 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 Jul 06 12:40:23 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-876ead05-fa07-4e84-9686-2dcadd3119a9-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-876ead05-fa07-4e84-9686-2dcadd3119a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-d1cace6f-bb3b-465a-86d7-b3d20fd415df" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-d1cace6f-bb3b-465a-86d7-b3d20fd415df" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-876ead05-fa07-4e84-9686-2dcadd3119a9" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-876ead05-fa07-4e84-9686-2dcadd3119a9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Deleting offline snapshot 876ead05-fa07-4e84-9686-2dcadd3119a9 of volume d1cace6f-bb3b-465a-86d7-b3d20fd415df {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] snapshot_file for this snap is: volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e78103b-7e86-4223-990c-c7dbeb9fd4fc]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:23 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 Jul 06 12:40:23 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:23 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2" returned: 0 in 0.807s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:23 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2 Jul 06 12:40:23 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:24 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9" returned: 0 in 0.833s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7a31c2-7855-4285-9fbe-c0fda82c08de]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:24 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df Jul 06 12:40:24 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:24 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2" returned: 0 in 0.683s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2" released by "delete_volume" :: held 1.554s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Created reservations ['6ca4d67a-1952-4795-b4e6-6ff059b6fc4c', 'bc3bdcc9-7307-4dd9-be33-85f73205d91e', 'a55387ec-65de-4cdc-b0f6-22a3f6b714e8', '1fa6870c-0551-4231-b502-23e55a1bec37'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:24 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:40:24 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:25 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df" returned: 0 in 0.868s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:25 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 Jul 06 12:40:25 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:25 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.707s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Deleted volume successfully. Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bbbce626-c873-44d7-9acf-444685af1f53 tempest-ProjectReaderTests-189174883 None] Lock "cinder-53c37102-71ac-40f2-b9ed-6b76ef7aa9e2-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (0784d3b2-2ef6-402a-bf8d-b89a865ef91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6242ba-91d0-4802-87f2-ee118880963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6242ba-91d0-4802-87f2-ee118880963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1106841433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27aa2606-6fe6-41bd-9349-1536b2eb233a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:25Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a223efc-e7ba-4c9a-8f9f-3679876a31e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a223efc-e7ba-4c9a-8f9f-3679876a31e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9553646-0266-42e9-980f-c641da20232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9553646-0266-42e9-980f-c641da20232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27aa2606-6fe6-41bd-9349-1536b2eb233a', 'volume_name': 'volume-27aa2606-6fe6-41bd-9349-1536b2eb233a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a90e6b-573c-4451-9ecf-83b6c5689b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a90e6b-573c-4451-9ecf-83b6c5689b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ce2f65-b02c-4481-94cf-5148fbf1f5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Volume 27aa2606-6fe6-41bd-9349-1536b2eb233a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27aa2606-6fe6-41bd-9349-1536b2eb233a', 'volume_size': 1} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1106841433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27aa2606-6fe6-41bd-9349-1536b2eb233a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:25Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Creating volume 27aa2606-6fe6-41bd-9349-1536b2eb233a {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:25 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:25 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a 1073741824 Jul 06 12:40:25 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:25 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9" returned: 0 in 0.788s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:25 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9 Jul 06 12:40:25 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:26 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a 1073741824" returned: 0 in 0.947s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:26 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df.876ead05-fa07-4e84-9686-2dcadd3119a9" returned: 0 in 0.741s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-876ead05-fa07-4e84-9686-2dcadd3119a9" released by "_delete_snapshot" :: held 3.351s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-d1cace6f-bb3b-465a-86d7-b3d20fd415df" released by "delete_snapshot" :: held 3.383s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:26 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a Jul 06 12:40:26 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:26 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Created reservations ['cc818e9c-343a-4d23-9831-2f8a4706dcf7', 'fd6f76b2-6f09-47e9-adae-445d7b08df52', '1a65b674-c122-437e-8dff-d39847e8a273', 'a79f2933-2677-4d30-aee4-197465521918'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:26 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Delete snapshot completed successfully. Jul 06 12:40:26 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8ed0e2a-d3e4-4245-bc01-e74cedbee196 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-876ead05-fa07-4e84-9686-2dcadd3119a9-delete_snapshot" released by "delete_snapshot" :: held 3.536s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:27 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a" returned: 0 in 0.661s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ce2f65-b02c-4481-94cf-5148fbf1f5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27aa2606-6fe6-41bd-9349-1536b2eb233a', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76bce146-27fc-4a8e-a5af-dd2897cca214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Volume volume-27aa2606-6fe6-41bd-9349-1536b2eb233a (27aa2606-6fe6-41bd-9349-1536b2eb233a): created successfully Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76bce146-27fc-4a8e-a5af-dd2897cca214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (0784d3b2-2ef6-402a-bf8d-b89a865ef91f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3d659955-219e-4b4a-899c-680239b9b7b9 tempest-ProjectReaderTests-189174883 None] Created volume successfully. Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-d1cace6f-bb3b-465a-86d7-b3d20fd415df-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-d1cace6f-bb3b-465a-86d7-b3d20fd415df-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-d1cace6f-bb3b-465a-86d7-b3d20fd415df" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-d1cace6f-bb3b-465a-86d7-b3d20fd415df" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e224ec-be78-4d10-bce3-11857139f0c9]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:27 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df Jul 06 12:40:27 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] Creating offline snapshot 9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 of volume 27aa2606-6fe6-41bd-9349-1536b2eb233a {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b897689e-3141-473f-a82f-1e3ef7ec82cd]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:28 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a Jul 06 12:40:28 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:28 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df" returned: 0 in 0.855s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:28 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df Jul 06 12:40:28 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:28 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a" returned: 0 in 0.830s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:28 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 1G Jul 06 12:40:28 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:29 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d1cace6f-bb3b-465a-86d7-b3d20fd415df" returned: 0 in 0.680s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-d1cace6f-bb3b-465a-86d7-b3d20fd415df" released by "delete_volume" :: held 1.618s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:29 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Created reservations ['e2915054-c610-4a90-a6e9-45b6f770bb14', '1ac10053-9a03-4dac-b1f4-a3e32b8ee77a', '0d1bbecf-419b-41e1-a7b8-92a866911521', '24999646-4d29-4491-a805-bc0d241bd898'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:29 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:40:29 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:29 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 1G" returned: 0 in 0.828s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27aa2606-6fe6-41bd-9349-1536b2eb233a -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:29 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27aa2606-6fe6-41bd-9349-1536b2eb233a -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 Jul 06 12:40:29 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:30 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.713s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:30 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Deleted volume successfully. Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b3420b55-edf3-47e9-a5d2-e1ff0b1e3ac7 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-d1cace6f-bb3b-465a-86d7-b3d20fd415df-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (fec080d3-399b-4ccc-95bf-7f362c894f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d92df39-93ae-45d0-a1cb-c281b2772a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d92df39-93ae-45d0-a1cb-c281b2772a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078769301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e52240-f9f6-4de2-a2bb-ffc750cdcafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:30Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdd6512-25c1-4e68-ad85-2dc8554573b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdd6512-25c1-4e68-ad85-2dc8554573b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf28f4c5-d129-4e72-8e47-836c71c69ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf28f4c5-d129-4e72-8e47-836c71c69ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e52240-f9f6-4de2-a2bb-ffc750cdcafc', 'volume_name': 'volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:30 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7eeca4c-723a-4b91-b3af-bac54a418d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7eeca4c-723a-4b91-b3af-bac54a418d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8eb9675-2185-425d-9e9e-3b26afcdb418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:30 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Volume 83e52240-f9f6-4de2-a2bb-ffc750cdcafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc', 'volume_size': 1} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27aa2606-6fe6-41bd-9349-1536b2eb233a -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63" returned: 0 in 0.813s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:30 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 is being set with open permissions: ugo+rw Jul 06 12:40:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:30 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 Jul 06 12:40:30 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:31 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63" returned: 0 in 0.751s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:31 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.info Jul 06 12:40:31 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:31 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.info" returned: 0 in 0.725s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:31 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.info is being set with open permissions: ugo+rw Jul 06 12:40:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:31 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.info Jul 06 12:40:31 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:32 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.info" returned: 0 in 0.681s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.746s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.221s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078769301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e52240-f9f6-4de2-a2bb-ffc750cdcafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:30Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Creating volume 83e52240-f9f6-4de2-a2bb-ffc750cdcafc {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:32 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:32 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc 1073741824 Jul 06 12:40:32 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-41b3631f-91d2-4dfc-bd96-e80a5ee79ee4 tempest-ProjectReaderTests-189174883 None] Create snapshot completed successfully Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:32 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:40:32 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-9abef76d-dd3b-40f5-b1b3-0bd942c4fe63-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Lock "cinder-9abef76d-dd3b-40f5-b1b3-0bd942c4fe63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-27aa2606-6fe6-41bd-9349-1536b2eb233a" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-27aa2606-6fe6-41bd-9349-1536b2eb233a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-9abef76d-dd3b-40f5-b1b3-0bd942c4fe63" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-9abef76d-dd3b-40f5-b1b3-0bd942c4fe63" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Deleting offline snapshot 9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 of volume 27aa2606-6fe6-41bd-9349-1536b2eb233a {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] snapshot_file for this snap is: volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[143471a0-c6f1-49f5-b23b-c50d5a873f78]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:33 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 Jul 06 12:40:33 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:33 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc 1073741824" returned: 0 in 0.901s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:33 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc Jul 06 12:40:33 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:33 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.748s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:40:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:40:34 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63" returned: 0 in 0.801s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27aa2606-6fe6-41bd-9349-1536b2eb233a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b8acb9-8bb9-49be-b352-ebed3a1be1a3]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:34 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a Jul 06 12:40:34 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:34 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc" returned: 0 in 0.697s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8eb9675-2185-425d-9e9e-3b26afcdb418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be823a7-7f11-4050-9791-3abaa2d5027d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:34 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Volume volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc (83e52240-f9f6-4de2-a2bb-ffc750cdcafc): created successfully Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be823a7-7f11-4050-9791-3abaa2d5027d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (fec080d3-399b-4ccc-95bf-7f362c894f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-42971e18-af65-4e75-8de3-760396836293 tempest-ProjectMemberTests-1109497705 None] Created volume successfully. Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] Creating offline snapshot e294a1ce-a672-4de4-a6dc-508aff3d3ea4 of volume 83e52240-f9f6-4de2-a2bb-ffc750cdcafc {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e755434c-307c-4d8d-8dcc-bcce653a4632]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:34 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc Jul 06 12:40:34 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:34 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a" returned: 0 in 0.798s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:34 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 Jul 06 12:40:34 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:35 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc" returned: 0 in 0.806s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:35 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 1G Jul 06 12:40:35 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:35 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63" returned: 0 in 0.778s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:35 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63 Jul 06 12:40:35 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:36 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 1G" returned: 0 in 0.865s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:36 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a.9abef76d-dd3b-40f5-b1b3-0bd942c4fe63" returned: 0 in 0.755s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:36 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 Jul 06 12:40:36 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-9abef76d-dd3b-40f5-b1b3-0bd942c4fe63" released by "_delete_snapshot" :: held 3.234s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-27aa2606-6fe6-41bd-9349-1536b2eb233a" released by "delete_snapshot" :: held 3.263s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:36 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Created reservations ['ea9faf59-1e17-423d-a584-008ff96f5a49', 'a8e7c7d9-2900-4f03-8ca2-fbf629ac3554', 'd55f221f-65cf-4931-9b09-e33efcb1bd66', '01a20cd2-dd56-4b30-a838-aaa8cbca7312'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Delete snapshot completed successfully. Jul 06 12:40:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5a205024-2478-4460-bedc-f3534473e153 tempest-ProjectReaderTests-189174883 None] Lock "cinder-9abef76d-dd3b-40f5-b1b3-0bd942c4fe63-delete_snapshot" released by "delete_snapshot" :: held 3.417s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:37 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4" returned: 0 in 0.665s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:37 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 is being set with open permissions: ugo+rw Jul 06 12:40:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:37 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 Jul 06 12:40:37 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-27aa2606-6fe6-41bd-9349-1536b2eb233a-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Lock "cinder-27aa2606-6fe6-41bd-9349-1536b2eb233a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-27aa2606-6fe6-41bd-9349-1536b2eb233a" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-27aa2606-6fe6-41bd-9349-1536b2eb233a" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:37 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2487b0-8bca-4b40-bd66-62144580a360]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:37 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a Jul 06 12:40:37 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:37 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4" returned: 0 in 0.705s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:37 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.info Jul 06 12:40:37 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:38 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a" returned: 0 in 0.825s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:38 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a Jul 06 12:40:38 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:38 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.info" returned: 0 in 0.647s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:38 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.info is being set with open permissions: ugo+rw Jul 06 12:40:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:38 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.info Jul 06 12:40:38 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:38 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-27aa2606-6fe6-41bd-9349-1536b2eb233a" returned: 0 in 0.694s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-27aa2606-6fe6-41bd-9349-1536b2eb233a" released by "delete_volume" :: held 1.577s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Created reservations ['b8eb7404-c430-40f0-91dd-c1912fba3f33', 'ae90f4f6-0ec9-4a1c-9c21-0765fa6c6fa4', '1dcf73b5-222e-4709-9c52-b24ba2773882', '05c35adc-dd71-4e86-a3a1-d50196dcb6e6'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:39 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.info" returned: 0 in 0.626s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.408s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1d752101-755a-43cd-ada8-17a677f1ee12 tempest-ProjectMemberTests-1109497705 None] Create snapshot completed successfully Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:39 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:40:39 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:39 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.637s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Deleted volume successfully. Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-6a85b21b-d84a-40f2-bc71-d6acb7b35e24 tempest-ProjectReaderTests-189174883 None] Lock "cinder-27aa2606-6fe6-41bd-9349-1536b2eb233a-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-e294a1ce-a672-4de4-a6dc-508aff3d3ea4-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Lock "cinder-e294a1ce-a672-4de4-a6dc-508aff3d3ea4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-83e52240-f9f6-4de2-a2bb-ffc750cdcafc" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-83e52240-f9f6-4de2-a2bb-ffc750cdcafc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-e294a1ce-a672-4de4-a6dc-508aff3d3ea4" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-e294a1ce-a672-4de4-a6dc-508aff3d3ea4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:39 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Deleting offline snapshot e294a1ce-a672-4de4-a6dc-508aff3d3ea4 of volume 83e52240-f9f6-4de2-a2bb-ffc750cdcafc {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] snapshot_file for this snap is: volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad12e085-5392-4043-bf4c-93ec8e82a9de]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (91be29fc-3ca1-4ed8-b98d-cacafb7641aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db42471-ecf1-44b5-bebc-4b0f17e277e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db42471-ecf1-44b5-bebc-4b0f17e277e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-726222807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0c5e33-7d9e-413e-af78-d7bad6fdf32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:40Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6497fb-807a-4e04-ac8a-dd62225147f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6497fb-807a-4e04-ac8a-dd62225147f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d1280f-12ce-4ec8-952b-47a20fbf6464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d1280f-12ce-4ec8-952b-47a20fbf6464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0c5e33-7d9e-413e-af78-d7bad6fdf32c', 'volume_name': 'volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1b2177-69d5-4e89-a5b2-af61f1cb1910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:40 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 Jul 06 12:40:40 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1b2177-69d5-4e89-a5b2-af61f1cb1910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed46dc70-bd0c-4b3e-9978-79dc5500d8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:40 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Volume 1d0c5e33-7d9e-413e-af78-d7bad6fdf32c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c', 'volume_size': 1} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-726222807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0c5e33-7d9e-413e-af78-d7bad6fdf32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:40Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Creating volume 1d0c5e33-7d9e-413e-af78-d7bad6fdf32c {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:40 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:40 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c 1073741824 Jul 06 12:40:40 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:40 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4" returned: 0 in 0.749s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7a288-a86e-4fc6-953e-e379a2eeeed4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:40 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc Jul 06 12:40:40 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:41 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c 1073741824" returned: 0 in 0.907s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:41 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c Jul 06 12:40:41 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:41 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc" returned: 0 in 0.817s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:41 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 Jul 06 12:40:41 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:41 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c" returned: 0 in 0.704s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:40:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed46dc70-bd0c-4b3e-9978-79dc5500d8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c742d891-9994-4cbe-bd21-2e91c2cc32a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:41 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Volume volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c (1d0c5e33-7d9e-413e-af78-d7bad6fdf32c): created successfully Jul 06 12:40:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c742d891-9994-4cbe-bd21-2e91c2cc32a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:41 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (91be29fc-3ca1-4ed8-b98d-cacafb7641aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ff6a2a3c-ba90-44d8-8ec2-95dfe834071e tempest-ProjectReaderTests-189174883 None] Created volume successfully. Jul 06 12:40:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] Creating offline snapshot a3265dbe-b42a-4ca4-b6cc-e67c51d5a503 of volume 1d0c5e33-7d9e-413e-af78-d7bad6fdf32c {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:40:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7726e9c9-1744-4a3d-886b-7ff346a632e2]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:42 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4" returned: 0 in 0.805s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:42 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4 Jul 06 12:40:42 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:42 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c Jul 06 12:40:42 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:43 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:43 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc.e294a1ce-a672-4de4-a6dc-508aff3d3ea4" returned: 0 in 0.720s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c" returned: 0 in 0.812s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.a3265dbe-b42a-4ca4-b6cc-e67c51d5a503 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-e294a1ce-a672-4de4-a6dc-508aff3d3ea4" released by "_delete_snapshot" :: held 3.213s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-83e52240-f9f6-4de2-a2bb-ffc750cdcafc" released by "delete_snapshot" :: held 3.245s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:43 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.a3265dbe-b42a-4ca4-b6cc-e67c51d5a503 1G Jul 06 12:40:43 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:43 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Created reservations ['27bf1b18-2daf-423b-8c1f-b0ad4b663c18', '9148d21a-458e-4191-a834-e7ec827cdee2', '12ae93a2-d544-468a-a78e-e7a441f1485e', '3e9700f5-2e5b-4e67-b390-17e128596308'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:43 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Delete snapshot completed successfully. Jul 06 12:40:43 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-139690e1-ab63-4c6f-b929-edb18f96b18e tempest-ProjectMemberTests-1109497705 None] Lock "cinder-e294a1ce-a672-4de4-a6dc-508aff3d3ea4-delete_snapshot" released by "delete_snapshot" :: held 3.405s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:44 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.a3265dbe-b42a-4ca4-b6cc-e67c51d5a503 1G" returned: 0 in 0.839s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.a3265dbe-b42a-4ca4-b6cc-e67c51d5a503 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:44 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.a3265dbe-b42a-4ca4-b6cc-e67c51d5a503 Jul 06 12:40:44 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-83e52240-f9f6-4de2-a2bb-ffc750cdcafc-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-83e52240-f9f6-4de2-a2bb-ffc750cdcafc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-83e52240-f9f6-4de2-a2bb-ffc750cdcafc" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:44 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-83e52240-f9f6-4de2-a2bb-ffc750cdcafc" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:44 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e6adbc-b043-4984-8866-202a29ec2467]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:44 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc Jul 06 12:40:44 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:44 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.a3265dbe-b42a-4ca4-b6cc-e67c51d5a503" returned: 0 in 0.836s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:44 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.a3265dbe-b42a-4ca4-b6cc-e67c51d5a503 is being set with open permissions: ugo+rw Jul 06 12:40:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.a3265dbe-b42a-4ca4-b6cc-e67c51d5a503 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:44 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.a3265dbe-b42a-4ca4-b6cc-e67c51d5a503 Jul 06 12:40:44 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:45 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc" returned: 0 in 0.861s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:45 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc Jul 06 12:40:45 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:45 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.a3265dbe-b42a-4ca4-b6cc-e67c51d5a503" returned: 0 in 0.755s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:45 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.info Jul 06 12:40:45 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:46 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-83e52240-f9f6-4de2-a2bb-ffc750cdcafc" returned: 0 in 0.784s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-83e52240-f9f6-4de2-a2bb-ffc750cdcafc" released by "delete_volume" :: held 1.737s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Created reservations ['2997f583-1961-4634-a87c-c9d74b9ff7d7', 'f18d086b-d908-42d4-ab23-bcb3e1242aa5', '4f8b5356-c8a8-44d4-ab71-6c71644f2257', '2b52d52d-a931-4bba-b577-f6bee61f91db'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:46 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:40:46 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:46 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.info" returned: 0 in 0.744s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:46 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.info is being set with open permissions: ugo+rw Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:46 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.info Jul 06 12:40:46 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:46 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (ae0a9630-2314-4fa6-8432-817a6b20cec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3ff7cc-0fc4-47a0-ac9e-7d0f28e3c2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3ff7cc-0fc4-47a0-ac9e-7d0f28e3c2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1400727352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b522af9-5a7c-484c-97cf-4105bb7f6308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:47Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7977f8-c7af-486c-b904-5d016fceef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7977f8-c7af-486c-b904-5d016fceef1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15cc148-bfb7-4e5c-8736-bb6125403f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:47 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15cc148-bfb7-4e5c-8736-bb6125403f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b522af9-5a7c-484c-97cf-4105bb7f6308', 'volume_name': 'volume-1b522af9-5a7c-484c-97cf-4105bb7f6308', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4715b8e0-9b63-40ee-82be-92e52cf1cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4715b8e0-9b63-40ee-82be-92e52cf1cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89b856a-a028-4fb1-aff9-a2e0e4a91788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:47 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Volume 1b522af9-5a7c-484c-97cf-4105bb7f6308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b522af9-5a7c-484c-97cf-4105bb7f6308', 'volume_size': 1} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.894s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:40:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Deleted volume successfully. Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=123,cinder:DELETE=15,cinder:UPDATE=145,cinder:INSERT=36 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e6941cd5-1fbc-4fd1-ad62-f46f7498dcc0 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-83e52240-f9f6-4de2-a2bb-ffc750cdcafc-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:47 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1d0c5e33-7d9e-413e-af78-d7bad6fdf32c.info" returned: 0 in 0.771s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.850s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1400727352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b522af9-5a7c-484c-97cf-4105bb7f6308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:40:47Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Creating volume 1b522af9-5a7c-484c-97cf-4105bb7f6308 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:40:47 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:DELETE=13,cinder:UPDATE=166,cinder:SELECT=116,cinder:INSERT=47 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:40:47 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 1073741824 Jul 06 12:40:47 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:47 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bad38d48-a4c0-4a03-a930-1ee85ec81e55 tempest-ProjectReaderTests-189174883 None] Create snapshot completed successfully Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0e4c79b-a370-481f-b1c5-6ea2f4b773c7 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-a3265dbe-b42a-4ca4-b6cc-e67c51d5a503-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0e4c79b-a370-481f-b1c5-6ea2f4b773c7 tempest-ProjectReaderTests-189174883 None] Lock "cinder-a3265dbe-b42a-4ca4-b6cc-e67c51d5a503-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:47 devstack cinder-volume[86561]: INFO cinder.message.api [None req-b0e4c79b-a370-481f-b1c5-6ea2f4b773c7 tempest-ProjectReaderTests-189174883 None] Creating message record for request_id = req-b0e4c79b-a370-481f-b1c5-6ea2f4b773c7 Jul 06 12:40:47 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0e4c79b-a370-481f-b1c5-6ea2f4b773c7 tempest-ProjectReaderTests-189174883 None] Lock "cinder-a3265dbe-b42a-4ca4-b6cc-e67c51d5a503-delete_snapshot" released by "delete_snapshot" :: held 0.047s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server [None req-b0e4c79b-a370-481f-b1c5-6ea2f4b773c7 tempest-ProjectReaderTests-189174883 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server raise self.value Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:40:47 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server Jul 06 12:40:48 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 1073741824" returned: 0 in 0.840s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:48 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 Jul 06 12:40:48 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:48 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308" returned: 0 in 0.632s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:40:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89b856a-a028-4fb1-aff9-a2e0e4a91788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b522af9-5a7c-484c-97cf-4105bb7f6308', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af35892a-bfcd-4e65-83b4-c0eba3df2df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:40:48 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Volume volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 (1b522af9-5a7c-484c-97cf-4105bb7f6308): created successfully Jul 06 12:40:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af35892a-bfcd-4e65-83b4-c0eba3df2df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:40:48 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (ae0a9630-2314-4fa6-8432-817a6b20cec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:40:48 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-88ae6470-15e5-4f71-b39a-16c4ec18478f tempest-ProjectMemberTests-1109497705 None] Created volume successfully. Jul 06 12:40:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:40:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:40:49 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] Creating offline snapshot 5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 of volume 1b522af9-5a7c-484c-97cf-4105bb7f6308 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:40:49 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be6d24d-9e39-4a81-8330-c54dc0ea7aec]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:49 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 Jul 06 12:40:49 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:49 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308" returned: 0 in 0.748s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:50 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 1G Jul 06 12:40:50 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:50 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 1G" returned: 0 in 0.840s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:50 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 Jul 06 12:40:50 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:51 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58" returned: 0 in 0.724s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:51 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 is being set with open permissions: ugo+rw Jul 06 12:40:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:51 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 Jul 06 12:40:51 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:52 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58" returned: 0 in 0.654s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:52 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.info Jul 06 12:40:52 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:52 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.info" returned: 0 in 0.726s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:52 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.info is being set with open permissions: ugo+rw Jul 06 12:40:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:52 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.info Jul 06 12:40:52 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:53 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.info" returned: 0 in 0.671s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.446s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:40:53 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a5cfdf68-4126-42af-a7f5-49bd91a9ec0b tempest-ProjectMemberTests-1109497705 None] Create snapshot completed successfully Jul 06 12:40:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-5abfe4a9-f9b0-4280-a618-d1cc4c75cf58-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Lock "cinder-5abfe4a9-f9b0-4280-a618-d1cc4c75cf58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-1b522af9-5a7c-484c-97cf-4105bb7f6308" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-1b522af9-5a7c-484c-97cf-4105bb7f6308" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-5abfe4a9-f9b0-4280-a618-d1cc4c75cf58" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-5abfe4a9-f9b0-4280-a618-d1cc4c75cf58" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Deleting offline snapshot 5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 of volume 1b522af9-5a7c-484c-97cf-4105bb7f6308 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:40:54 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] snapshot_file for this snap is: volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:40:54 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f78f26c-ed14-4dff-bc32-d5dfc403641a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:54 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:54 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 Jul 06 12:40:54 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:55 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58" returned: 0 in 0.809s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:55 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b522af9-5a7c-484c-97cf-4105bb7f6308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:40:55 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[742642c0-3d44-43b7-889a-07f9bbca0f95]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:55 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 Jul 06 12:40:55 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:56 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308" returned: 0 in 0.839s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:56 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 Jul 06 12:40:56 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:56 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58" returned: 0 in 0.764s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:57 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58 Jul 06 12:40:57 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:57 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308.5abfe4a9-f9b0-4280-a618-d1cc4c75cf58" returned: 0 in 0.747s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-5abfe4a9-f9b0-4280-a618-d1cc4c75cf58" released by "_delete_snapshot" :: held 3.261s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-1b522af9-5a7c-484c-97cf-4105bb7f6308" released by "delete_snapshot" :: held 3.289s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:57 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Created reservations ['d5066ce5-203c-4b77-ae97-c17ad9446e63', 'b2a6f4a0-3b81-46f9-be27-3b5068295133', '80a2365d-ee22-431f-9398-a19488f75f56', '46aee97b-5d2a-4866-9aa0-22bb4a3b3391'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:40:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Delete snapshot completed successfully. Jul 06 12:40:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-5dad49aa-6815-4b70-b30c-b4e74c7b3a6c tempest-ProjectMemberTests-1109497705 None] Lock "cinder-5abfe4a9-f9b0-4280-a618-d1cc4c75cf58-delete_snapshot" released by "delete_snapshot" :: held 3.501s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:40:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-1b522af9-5a7c-484c-97cf-4105bb7f6308-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-1b522af9-5a7c-484c-97cf-4105bb7f6308-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-1b522af9-5a7c-484c-97cf-4105bb7f6308" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:40:58 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-1b522af9-5a7c-484c-97cf-4105bb7f6308" acquired by "delete_volume" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:40:58 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58e9f6a-b54b-4f16-aad1-d622492d2b20]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:40:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:58 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 Jul 06 12:40:58 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:40:59 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 06 12:40:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308" returned: 0 in 0.865s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:40:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:40:59 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308 Jul 06 12:40:59 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:00 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1b522af9-5a7c-484c-97cf-4105bb7f6308" returned: 0 in 0.709s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:00 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-1b522af9-5a7c-484c-97cf-4105bb7f6308" released by "delete_volume" :: held 1.638s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:00 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Created reservations ['a97e0d67-05b9-45e2-8a3e-26cabfc8ccd3', 'fa286fb6-7fc1-4b3d-9f27-7488e265093c', 'c181a5ee-117d-47e0-b312-4dc66e93a9a0', 'af0b0b8d-8420-4cb2-be4b-8e2c132e1962'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:41:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:00 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:00 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:41:00 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:01 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.756s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:41:01 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Deleted volume successfully. Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-061bc30f-55a3-48ed-88eb-c04d6aebed61 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-1b522af9-5a7c-484c-97cf-4105bb7f6308-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (e843e79c-f23c-4b76-95c8-b093d595a3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9add78a4-a1c1-4b5e-98a5-140461847522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9add78a4-a1c1-4b5e-98a5-140461847522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1476099492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02b6e01-70ba-4941-81f7-40d13c62ac30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:41:01Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e70b628-0aef-4eb0-b0b4-17ba2537d983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e70b628-0aef-4eb0-b0b4-17ba2537d983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beef7ca3-6665-4945-ba35-2bc6f9db58a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beef7ca3-6665-4945-ba35-2bc6f9db58a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02b6e01-70ba-4941-81f7-40d13c62ac30', 'volume_name': 'volume-f02b6e01-70ba-4941-81f7-40d13c62ac30', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3170e620-8479-4fc6-ae54-281a996a0942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3170e620-8479-4fc6-ae54-281a996a0942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d5bdbf-eeee-4b7e-8cb9-9b9a0bca3811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:01 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Volume f02b6e01-70ba-4941-81f7-40d13c62ac30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02b6e01-70ba-4941-81f7-40d13c62ac30', 'volume_size': 1} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1476099492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02b6e01-70ba-4941-81f7-40d13c62ac30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:41:01Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Creating volume f02b6e01-70ba-4941-81f7-40d13c62ac30 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:41:01 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:41:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:01 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30 1073741824 Jul 06 12:41:01 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:02 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30 1073741824" returned: 0 in 0.895s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:02 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30 Jul 06 12:41:02 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:03 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30" returned: 0 in 0.716s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d5bdbf-eeee-4b7e-8cb9-9b9a0bca3811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02b6e01-70ba-4941-81f7-40d13c62ac30', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ca9ed9-4b83-4940-8e5a-9624a6e9efc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:41:03 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Volume volume-f02b6e01-70ba-4941-81f7-40d13c62ac30 (f02b6e01-70ba-4941-81f7-40d13c62ac30): created successfully Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ca9ed9-4b83-4940-8e5a-9624a6e9efc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (e843e79c-f23c-4b76-95c8-b093d595a3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:41:03 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-64ffee05-cc57-4281-890b-97c099fc7295 tempest-ProjectMemberTests-1109497705 None] Created volume successfully. Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] Creating offline snapshot 9cb4835b-f14b-4cf0-afb4-91b31db6225d of volume f02b6e01-70ba-4941-81f7-40d13c62ac30 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76d2b19-471d-4313-902b-414554e4fe72]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:41:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:03 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30 Jul 06 12:41:03 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:04 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30" returned: 0 in 0.817s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.9cb4835b-f14b-4cf0-afb4-91b31db6225d 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:04 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.9cb4835b-f14b-4cf0-afb4-91b31db6225d 1G Jul 06 12:41:04 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:05 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.9cb4835b-f14b-4cf0-afb4-91b31db6225d 1G" returned: 0 in 0.866s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02b6e01-70ba-4941-81f7-40d13c62ac30 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.9cb4835b-f14b-4cf0-afb4-91b31db6225d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:05 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02b6e01-70ba-4941-81f7-40d13c62ac30 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.9cb4835b-f14b-4cf0-afb4-91b31db6225d Jul 06 12:41:05 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:06 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f02b6e01-70ba-4941-81f7-40d13c62ac30 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.9cb4835b-f14b-4cf0-afb4-91b31db6225d" returned: 0 in 0.807s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:06 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.9cb4835b-f14b-4cf0-afb4-91b31db6225d is being set with open permissions: ugo+rw Jul 06 12:41:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.9cb4835b-f14b-4cf0-afb4-91b31db6225d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:06 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.9cb4835b-f14b-4cf0-afb4-91b31db6225d Jul 06 12:41:06 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:07 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.9cb4835b-f14b-4cf0-afb4-91b31db6225d" returned: 0 in 0.784s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:07 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.info Jul 06 12:41:07 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:07 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.info" returned: 0 in 0.775s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:07 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.info is being set with open permissions: ugo+rw Jul 06 12:41:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:07 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.info Jul 06 12:41:07 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:08 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-f02b6e01-70ba-4941-81f7-40d13c62ac30.info" returned: 0 in 0.673s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.807s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cdffa3c2-8434-4b9b-9371-bc1ac09df376 tempest-ProjectMemberTests-1109497705 None] Create snapshot completed successfully Jul 06 12:41:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c75f0fa-0ecf-490c-8139-d6097139dac7 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-9cb4835b-f14b-4cf0-afb4-91b31db6225d-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:41:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c75f0fa-0ecf-490c-8139-d6097139dac7 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-9cb4835b-f14b-4cf0-afb4-91b31db6225d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:41:08 devstack cinder-volume[86561]: INFO cinder.message.api [None req-4c75f0fa-0ecf-490c-8139-d6097139dac7 tempest-ProjectMemberTests-1109497705 None] Creating message record for request_id = req-4c75f0fa-0ecf-490c-8139-d6097139dac7 Jul 06 12:41:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c75f0fa-0ecf-490c-8139-d6097139dac7 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-9cb4835b-f14b-4cf0-afb4-91b31db6225d-delete_snapshot" released by "delete_snapshot" :: held 0.035s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server [None req-4c75f0fa-0ecf-490c-8139-d6097139dac7 tempest-ProjectMemberTests-1109497705 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server raise self.value Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 12:41:08 devstack cinder-volume[86561]: ERROR oslo_messaging.rpc.server Jul 06 12:41:18 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:INSERT=7,cinder:UPDATE=21,cinder:SELECT=17,cinder:DELETE=2 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:41:18 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=26,cinder:DELETE=4,cinder:SELECT=18,cinder:INSERT=7 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:41:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:41:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:41:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:41:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:41:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:41:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:41:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:41:32 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:41:32 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:41:33 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 06 12:41:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.661s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:41:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:41:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:41:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:41:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:41:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:41:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:42:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:42:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:42:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:42:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:42:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:42:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:42:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:42:32 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:42:32 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:42:33 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Jul 06 12:42:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.630s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:42:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:42:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:42:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:42:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:43:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:43:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:43:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:43:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:43:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:43:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:43:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:43:32 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:43:32 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:43:33 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 06 12:43:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.611s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:43:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:43:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:43:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:43:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:43:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:43:39 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=1 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:44:03 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:44:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (856f0fab-c7ca-45c5-98de-9545c2156124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46123db-c4a3-41ec-9d4c-8a22cef67f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46123db-c4a3-41ec-9d4c-8a22cef67f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178874308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd8c5c1-59d1-4c29-96ea-d2a66be9a617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:04Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd4ca01-5f5d-4fa6-96b7-600b546758fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd4ca01-5f5d-4fa6-96b7-600b546758fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516d9952-0036-4b84-8e61-92a8630ce5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516d9952-0036-4b84-8e61-92a8630ce5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd8c5c1-59d1-4c29-96ea-d2a66be9a617', 'volume_name': 'volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f96a47e-d7cb-4335-a9d4-8d598f4c3cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:03 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f96a47e-d7cb-4335-a9d4-8d598f4c3cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1584f75-5c85-4fba-abed-87176c02b17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:04 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Volume 1dd8c5c1-59d1-4c29-96ea-d2a66be9a617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617', 'volume_size': 1} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178874308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd8c5c1-59d1-4c29-96ea-d2a66be9a617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:04Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Creating volume 1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:44:04 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:04 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 1073741824 Jul 06 12:44:04 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:04 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 1073741824" returned: 0 in 0.778s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:04 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 Jul 06 12:44:04 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:05 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617" returned: 0 in 0.635s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:44:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1584f75-5c85-4fba-abed-87176c02b17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a794da02-954f-4ad7-a1d2-f7c4ef37ed65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:05 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Volume volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 (1dd8c5c1-59d1-4c29-96ea-d2a66be9a617): created successfully Jul 06 12:44:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a794da02-954f-4ad7-a1d2-f7c4ef37ed65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:05 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (856f0fab-c7ca-45c5-98de-9545c2156124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:05 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-6e9b7ee0-a272-42b2-a80e-e6cad489bdb3 tempest-ProjectReaderTests-189174883 None] Created volume successfully. Jul 06 12:44:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:06 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] Creating offline snapshot bffa25f3-78e6-47b9-ad56-08fae40a281c of volume 1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:44:06 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1d4bde-ca34-4782-9d89-5c952cfc3239]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:06 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 Jul 06 12:44:06 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:06 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617" returned: 0 in 0.750s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:06 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c 1G Jul 06 12:44:06 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:07 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c 1G" returned: 0 in 0.822s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:07 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c Jul 06 12:44:07 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:08 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c" returned: 0 in 0.704s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:08 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c is being set with open permissions: ugo+rw Jul 06 12:44:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:08 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c Jul 06 12:44:08 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:09 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c" returned: 0 in 0.659s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:09 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.info Jul 06 12:44:09 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:09 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.info" returned: 0 in 0.633s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:09 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.info is being set with open permissions: ugo+rw Jul 06 12:44:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:09 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.info Jul 06 12:44:09 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:10 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.info" returned: 0 in 0.639s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.289s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-fa612e71-68c8-4a74-8efa-0f328b508e7c tempest-ProjectReaderTests-189174883 None] Create snapshot completed successfully Jul 06 12:44:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-bffa25f3-78e6-47b9-ad56-08fae40a281c-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Lock "cinder-bffa25f3-78e6-47b9-ad56-08fae40a281c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-bffa25f3-78e6-47b9-ad56-08fae40a281c" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:11 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-bffa25f3-78e6-47b9-ad56-08fae40a281c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Deleting offline snapshot bffa25f3-78e6-47b9-ad56-08fae40a281c of volume 1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:44:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] snapshot_file for this snap is: volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:44:11 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f05391-8f6a-403e-9f00-18ac8958598f]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:11 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c Jul 06 12:44:11 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:12 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c" returned: 0 in 0.763s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:44:12 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[965744cd-a285-4f03-8d38-04f66a9ef30e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:12 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 Jul 06 12:44:12 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:13 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617" returned: 0 in 0.762s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:13 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c Jul 06 12:44:13 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:13 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c" returned: 0 in 0.727s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:13 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c Jul 06 12:44:13 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:14 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617.bffa25f3-78e6-47b9-ad56-08fae40a281c" returned: 0 in 0.644s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-bffa25f3-78e6-47b9-ad56-08fae40a281c" released by "_delete_snapshot" :: held 2.994s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:14 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617" released by "delete_snapshot" :: held 3.022s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:14 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Created reservations ['14fd2667-e71e-44ba-91db-a36eb32fb15b', '50cc12a9-a7b7-435c-a268-8d61a5347841', 'd93673a9-d49c-447d-8eec-fc08d1fe9073', '844ce8e0-2ca4-46a0-81d5-090a90d417db'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:44:15 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Delete snapshot completed successfully. Jul 06 12:44:15 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-a75b6674-8dab-4a6c-84b3-f5aac2260efb tempest-ProjectReaderTests-189174883 None] Lock "cinder-bffa25f3-78e6-47b9-ad56-08fae40a281c-delete_snapshot" released by "delete_snapshot" :: held 4.447s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Lock "cinder-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:19 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[720911b7-f6ed-49bd-8060-f3928060439e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:19 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 Jul 06 12:44:19 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:19 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617" returned: 0 in 0.722s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:19 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617 Jul 06 12:44:19 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:20 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617" returned: 0 in 0.619s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:20 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617" released by "delete_volume" :: held 1.410s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:20 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Created reservations ['924ec194-1516-4ddc-9170-4c04760f73b8', '4e3ad18d-b723-4955-8e87-70c76410ad9d', '34fadf20-aa97-42a8-9364-86ee1838c873', '6f77cf6b-90a6-4881-b559-b22a4d7b5cd4'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:44:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:20 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:20 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:44:20 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:21 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.660s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:44:21 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Deleted volume successfully. Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4282530a-22eb-47e6-89d5-bfcbd5adcca7 tempest-ProjectReaderTests-189174883 None] Lock "cinder-1dd8c5c1-59d1-4c29-96ea-d2a66be9a617-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (8c95ecbe-7ea6-4a64-b328-943400879783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877b6922-e1f0-4fb1-834f-b10c2eb7330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877b6922-e1f0-4fb1-834f-b10c2eb7330b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-504501240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf0ccc0-1073-4173-b51e-975f255399dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:22Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3abd06-6d23-4f69-92df-50dfd0a136f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3abd06-6d23-4f69-92df-50dfd0a136f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fa3ba5-2908-468f-8bc4-70979b27199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fa3ba5-2908-468f-8bc4-70979b27199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf0ccc0-1073-4173-b51e-975f255399dd', 'volume_name': 'volume-eaf0ccc0-1073-4173-b51e-975f255399dd', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88b433a-a64a-4e22-ab9b-c81dc5d09cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88b433a-a64a-4e22-ab9b-c81dc5d09cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de54f18c-1e06-4d4f-82d1-4efd2ed4c6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:21 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Volume eaf0ccc0-1073-4173-b51e-975f255399dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf0ccc0-1073-4173-b51e-975f255399dd', 'volume_size': 1} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-504501240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf0ccc0-1073-4173-b51e-975f255399dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:22Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Creating volume eaf0ccc0-1073-4173-b51e-975f255399dd {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:44:21 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:44:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:21 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd 1073741824 Jul 06 12:44:21 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:22 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd 1073741824" returned: 0 in 0.796s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:22 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:22 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd Jul 06 12:44:22 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:23 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd" returned: 0 in 0.638s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:23 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:44:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de54f18c-1e06-4d4f-82d1-4efd2ed4c6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf0ccc0-1073-4173-b51e-975f255399dd', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc02d5d-a5b0-457c-ac53-aec0f2dc392d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:23 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Volume volume-eaf0ccc0-1073-4173-b51e-975f255399dd (eaf0ccc0-1073-4173-b51e-975f255399dd): created successfully Jul 06 12:44:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc02d5d-a5b0-457c-ac53-aec0f2dc392d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:23 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (8c95ecbe-7ea6-4a64-b328-943400879783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:23 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bcaa334a-90c0-4b48-843a-aaae754a16c2 tempest-ProjectReaderTests-189174883 None] Created volume successfully. Jul 06 12:44:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] Creating offline snapshot fbd248e1-a912-4867-99a1-d247572a12fb of volume eaf0ccc0-1073-4173-b51e-975f255399dd {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:44:24 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac4f3c5-e7c5-4b79-82dc-810dccbeb636]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:24 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd Jul 06 12:44:24 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:24 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd" returned: 0 in 0.746s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:24 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb 1G Jul 06 12:44:24 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (08f63f6f-02df-47e5-8e34-8600147c1af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dcbd31-7073-43f0-b4c7-a8574bdde57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dcbd31-7073-43f0-b4c7-a8574bdde57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1705884595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38366f51-9a44-4f05-b927-c7b160f37d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:25Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda9a130-eaa7-46d2-b7af-4a3fc00e82cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda9a130-eaa7-46d2-b7af-4a3fc00e82cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbefe4a-b158-4dc5-ace5-a64afcd9edc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cbefe4a-b158-4dc5-ace5-a64afcd9edc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38366f51-9a44-4f05-b927-c7b160f37d6d', 'volume_name': 'volume-38366f51-9a44-4f05-b927-c7b160f37d6d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8f8995-6f01-4178-80a8-52bc6d35ef6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8f8995-6f01-4178-80a8-52bc6d35ef6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbf62e0-3549-4226-8fa3-255444406da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Volume 38366f51-9a44-4f05-b927-c7b160f37d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38366f51-9a44-4f05-b927-c7b160f37d6d', 'volume_size': 1} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:25 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb 1G" returned: 0 in 0.795s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf0ccc0-1073-4173-b51e-975f255399dd -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:25 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf0ccc0-1073-4173-b51e-975f255399dd -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb Jul 06 12:44:25 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:26 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf0ccc0-1073-4173-b51e-975f255399dd -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb" returned: 0 in 0.704s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:26 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb is being set with open permissions: ugo+rw Jul 06 12:44:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:26 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb Jul 06 12:44:26 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:26 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb" returned: 0 in 0.607s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:26 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.info Jul 06 12:44:26 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:27 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.info" returned: 0 in 0.631s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:27 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.info is being set with open permissions: ugo+rw Jul 06 12:44:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:27 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.info Jul 06 12:44:27 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:28 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.info" returned: 0 in 0.607s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.178s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.984s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1705884595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38366f51-9a44-4f05-b927-c7b160f37d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:25Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Creating volume 38366f51-9a44-4f05-b927-c7b160f37d6d {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:44:28 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:28 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d 1073741824 Jul 06 12:44:28 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:28 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-9acf6e92-ea2d-4a46-9bed-456b12d25731 tempest-ProjectReaderTests-189174883 None] Create snapshot completed successfully Jul 06 12:44:28 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d 1073741824" returned: 0 in 0.768s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:29 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d Jul 06 12:44:29 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-fbd248e1-a912-4867-99a1-d247572a12fb-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Lock "cinder-fbd248e1-a912-4867-99a1-d247572a12fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-eaf0ccc0-1073-4173-b51e-975f255399dd" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-eaf0ccc0-1073-4173-b51e-975f255399dd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-fbd248e1-a912-4867-99a1-d247572a12fb" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-fbd248e1-a912-4867-99a1-d247572a12fb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Deleting offline snapshot fbd248e1-a912-4867-99a1-d247572a12fb of volume eaf0ccc0-1073-4173-b51e-975f255399dd {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] snapshot_file for this snap is: volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c4c997-6a35-4d99-91c4-5813fc33aabb]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:29 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb Jul 06 12:44:29 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:29 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d" returned: 0 in 0.635s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bbf62e0-3549-4226-8fa3-255444406da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38366f51-9a44-4f05-b927-c7b160f37d6d', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bab3514-e6dd-48fb-84c5-972925dbc081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:29 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Volume volume-38366f51-9a44-4f05-b927-c7b160f37d6d (38366f51-9a44-4f05-b927-c7b160f37d6d): created successfully Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bab3514-e6dd-48fb-84c5-972925dbc081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:29 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (08f63f6f-02df-47e5-8e34-8600147c1af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:29 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-a6a7e0e9-0a4a-4ca9-acfe-220054a04bb5 tempest-ProjectMemberTests-1109497705 None] Created volume successfully. Jul 06 12:44:30 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb" returned: 0 in 0.752s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaf0ccc0-1073-4173-b51e-975f255399dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:44:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5985c61-07de-441f-8a4a-ee201cd8d5cc]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:30 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd Jul 06 12:44:30 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:30 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] Creating offline snapshot 62f3a7cd-cc7b-4150-bb34-886aa61db103 of volume 38366f51-9a44-4f05-b927-c7b160f37d6d {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:44:30 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9167531b-d3b7-45c6-9e68-8cfdb1c4fdfb]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:30 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d Jul 06 12:44:30 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:30 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd" returned: 0 in 0.739s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:30 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb Jul 06 12:44:30 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:31 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d" returned: 0 in 0.730s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:31 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 1G Jul 06 12:44:31 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:31 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb" returned: 0 in 0.722s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:31 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb Jul 06 12:44:31 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:32 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 1G" returned: 0 in 0.786s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38366f51-9a44-4f05-b927-c7b160f37d6d -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:32 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38366f51-9a44-4f05-b927-c7b160f37d6d -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 Jul 06 12:44:32 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:32 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd.fbd248e1-a912-4867-99a1-d247572a12fb" returned: 0 in 0.624s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-fbd248e1-a912-4867-99a1-d247572a12fb" released by "_delete_snapshot" :: held 2.925s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-eaf0ccc0-1073-4173-b51e-975f255399dd" released by "delete_snapshot" :: held 2.945s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Created reservations ['37583302-bf4d-4ef8-8449-b3c561c39183', 'd0e9bacf-efeb-4d2b-a143-4903bc2c05c2', '5732e15c-7fad-4b3b-9eca-0faa0db5840b', 'ae3bf463-49f7-46ae-9647-de6b44c8d477'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:44:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Delete snapshot completed successfully. Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-2c3896f7-8633-46c3-af35-0f073245ffca tempest-ProjectReaderTests-189174883 None] Lock "cinder-fbd248e1-a912-4867-99a1-d247572a12fb-delete_snapshot" released by "delete_snapshot" :: held 3.078s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-eaf0ccc0-1073-4173-b51e-975f255399dd-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Lock "cinder-eaf0ccc0-1073-4173-b51e-975f255399dd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-eaf0ccc0-1073-4173-b51e-975f255399dd" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-eaf0ccc0-1073-4173-b51e-975f255399dd" acquired by "delete_volume" :: waited 0.013s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3130d35-08b4-402a-ba3b-cacd11f637a3]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:32 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd Jul 06 12:44:32 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:32 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38366f51-9a44-4f05-b927-c7b160f37d6d -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103" returned: 0 in 0.680s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:32 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 is being set with open permissions: ugo+rw Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:32 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 Jul 06 12:44:32 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:32 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:44:32 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:33 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd" returned: 0 in 0.743s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:33 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd Jul 06 12:44:33 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:33 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103" returned: 0 in 0.630s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:33 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.info Jul 06 12:44:33 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:33 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.644s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:44:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:44:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:44:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:44:33 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-eaf0ccc0-1073-4173-b51e-975f255399dd" returned: 0 in 0.628s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-eaf0ccc0-1073-4173-b51e-975f255399dd" released by "delete_volume" :: held 1.427s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Created reservations ['b171eed9-0c57-4c7b-8ec2-d944ae487f40', '60277ae0-1789-4437-93d5-cbbd9672ef14', '208932ca-2c3b-45d6-bc2b-1abba8799d88', '68927b1b-9612-4ba5-b4f6-7ff8ae81a402'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:34 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:44:34 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:34 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.info" returned: 0 in 0.657s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:34 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.info is being set with open permissions: ugo+rw Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:34 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.info Jul 06 12:44:34 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:34 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.644s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:44:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Deleted volume successfully. Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-bc1bbce3-b67c-4722-bcda-f28e15c576b1 tempest-ProjectReaderTests-189174883 None] Lock "cinder-eaf0ccc0-1073-4173-b51e-975f255399dd-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:34 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.info" returned: 0 in 0.657s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.231s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:34 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b3dbd512-d0d7-41b5-b3b5-d7d7e6d02739 tempest-ProjectMemberTests-1109497705 None] Create snapshot completed successfully Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (d44d3dcb-d6b6-43eb-a8f6-ff8325538dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bfb578-cc73-424f-b274-e7136085b1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bfb578-cc73-424f-b274-e7136085b1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-87526388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5616e13a-28bf-477e-a410-e2fef7763399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:35Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75642bc-9529-4e73-bb13-c98b4e85d70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75642bc-9529-4e73-bb13-c98b4e85d70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1843990-2410-4090-b6de-9b62d702a862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1843990-2410-4090-b6de-9b62d702a862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5616e13a-28bf-477e-a410-e2fef7763399', 'volume_name': 'volume-5616e13a-28bf-477e-a410-e2fef7763399', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68baa151-bd53-4b28-91f9-1f2f1d4e1277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68baa151-bd53-4b28-91f9-1f2f1d4e1277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf5ce2c-e631-4608-affa-964661e587e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:35 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Volume 5616e13a-28bf-477e-a410-e2fef7763399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5616e13a-28bf-477e-a410-e2fef7763399', 'volume_size': 1} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-87526388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5616e13a-28bf-477e-a410-e2fef7763399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25ea542711945c599663061cfece744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:35Z,use_quota=True,user_id='f0694e76056848d8bcb6be00d4048010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Creating volume 5616e13a-28bf-477e-a410-e2fef7763399 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:44:35 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:35 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 1073741824 Jul 06 12:44:35 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-62f3a7cd-cc7b-4150-bb34-886aa61db103-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-62f3a7cd-cc7b-4150-bb34-886aa61db103-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-38366f51-9a44-4f05-b927-c7b160f37d6d" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-38366f51-9a44-4f05-b927-c7b160f37d6d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-62f3a7cd-cc7b-4150-bb34-886aa61db103" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-62f3a7cd-cc7b-4150-bb34-886aa61db103" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Deleting offline snapshot 62f3a7cd-cc7b-4150-bb34-886aa61db103 of volume 38366f51-9a44-4f05-b927-c7b160f37d6d {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] snapshot_file for this snap is: volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3c2750-4a5e-4790-b93e-4e7cbb3009de]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:35 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 Jul 06 12:44:35 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:36 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 1073741824" returned: 0 in 0.897s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:36 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 Jul 06 12:44:36 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:36 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103" returned: 0 in 0.756s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38366f51-9a44-4f05-b927-c7b160f37d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7d5f5a-3c37-4002-9306-cc1e380883bf]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:36 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399" returned: 0 in 0.603s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf5ce2c-e631-4608-affa-964661e587e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5616e13a-28bf-477e-a410-e2fef7763399', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61241ed9-8caa-4ad6-9041-bd2525c3177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:36 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Volume volume-5616e13a-28bf-477e-a410-e2fef7763399 (5616e13a-28bf-477e-a410-e2fef7763399): created successfully Jul 06 12:44:36 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d Jul 06 12:44:36 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61241ed9-8caa-4ad6-9041-bd2525c3177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:36 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Flow 'volume_create_manager' (d44d3dcb-d6b6-43eb-a8f6-ff8325538dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-3c1cde7e-7ffe-4cdb-bb53-8130e94a4eea tempest-ProjectReaderTests-189174883 None] Created volume successfully. Jul 06 12:44:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] Creating offline snapshot d210820c-7466-47e2-9d8a-32d885677091 of volume 5616e13a-28bf-477e-a410-e2fef7763399 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:44:37 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6e35db-a855-4c97-a2a2-a25a22131063]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:37 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d" returned: 0 in 0.775s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:37 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 Jul 06 12:44:37 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:37 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 Jul 06 12:44:37 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:38 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399" returned: 0 in 0.759s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:38 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 1G Jul 06 12:44:38 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:38 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103" returned: 0 in 0.786s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:38 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103 Jul 06 12:44:38 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:38 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d.62f3a7cd-cc7b-4150-bb34-886aa61db103" returned: 0 in 0.623s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-62f3a7cd-cc7b-4150-bb34-886aa61db103" released by "_delete_snapshot" :: held 3.050s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-38366f51-9a44-4f05-b927-c7b160f37d6d" released by "delete_snapshot" :: held 3.074s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:38 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 1G" returned: 0 in 0.814s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5616e13a-28bf-477e-a410-e2fef7763399 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:38 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Created reservations ['792b21f9-db76-46d1-94f0-803c5492f015', '75119cef-fd69-40b7-be04-4d82485cd81a', '20e04d9f-7eb5-4246-b895-28201e13eb76', 'af057cc1-ee83-4407-8455-54884aa4cdf2'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:44:38 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5616e13a-28bf-477e-a410-e2fef7763399 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 Jul 06 12:44:38 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:39 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Delete snapshot completed successfully. Jul 06 12:44:39 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-98a836be-5879-472c-8f4c-316576c00730 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-62f3a7cd-cc7b-4150-bb34-886aa61db103-delete_snapshot" released by "delete_snapshot" :: held 3.230s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:39 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5616e13a-28bf-477e-a410-e2fef7763399 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091" returned: 0 in 0.663s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:39 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 is being set with open permissions: ugo+rw Jul 06 12:44:39 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:39 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 Jul 06 12:44:39 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-38366f51-9a44-4f05-b927-c7b160f37d6d-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-38366f51-9a44-4f05-b927-c7b160f37d6d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-38366f51-9a44-4f05-b927-c7b160f37d6d" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-38366f51-9a44-4f05-b927-c7b160f37d6d" acquired by "delete_volume" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb072c1-1fd5-4b3c-a1bb-abce226ec10a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:40 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d Jul 06 12:44:40 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:40 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091" returned: 0 in 0.675s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:40 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.info Jul 06 12:44:40 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:40 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d" returned: 0 in 0.752s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:40 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d Jul 06 12:44:40 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:40 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.info" returned: 0 in 0.664s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:40 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.info is being set with open permissions: ugo+rw Jul 06 12:44:40 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:41 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.info Jul 06 12:44:41 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:41 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-38366f51-9a44-4f05-b927-c7b160f37d6d" returned: 0 in 0.687s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:41 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-38366f51-9a44-4f05-b927-c7b160f37d6d" released by "delete_volume" :: held 1.508s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:41 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.info" returned: 0 in 0.667s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.337s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:41 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-df56efd2-b49f-469c-91c5-7fd364f34f6c tempest-ProjectReaderTests-189174883 None] Create snapshot completed successfully Jul 06 12:44:41 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Created reservations ['a0840dd8-6025-48b1-b59f-07e3fe473ce3', 'b7309396-e51f-445d-856e-4ce4ad4d6f96', '6249a1a8-c164-4128-8963-854ac119acc1', '930fbf0d-3751-48e4-bc10-b10ece72db92'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:44:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:41 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:41 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:41 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:44:41 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:42 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.623s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:44:42 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Deleted volume successfully. Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-cea35600-4663-4995-b3ec-de75b050c5f9 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-38366f51-9a44-4f05-b927-c7b160f37d6d-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-d210820c-7466-47e2-9d8a-32d885677091-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Lock "cinder-d210820c-7466-47e2-9d8a-32d885677091-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-5616e13a-28bf-477e-a410-e2fef7763399" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-5616e13a-28bf-477e-a410-e2fef7763399" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-d210820c-7466-47e2-9d8a-32d885677091" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-d210820c-7466-47e2-9d8a-32d885677091" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Deleting offline snapshot d210820c-7466-47e2-9d8a-32d885677091 of volume 5616e13a-28bf-477e-a410-e2fef7763399 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] snapshot_file for this snap is: volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb23016-9782-4ff8-a30d-bc01d75f62fa]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:42 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 Jul 06 12:44:42 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (2d5322e0-2165-4d39-8c3d-3fe105a2a962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f30fc258-a4b6-4fa9-a388-8074129adc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f30fc258-a4b6-4fa9-a388-8074129adc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344100588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445a2632-2bc6-41c7-b725-6966750bb5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:43Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0f96a7-bfc8-4cf3-ba0f-2da89d8261df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0f96a7-bfc8-4cf3-ba0f-2da89d8261df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378cbf35-cb86-4d8c-b469-e34772c74029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378cbf35-cb86-4d8c-b469-e34772c74029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445a2632-2bc6-41c7-b725-6966750bb5c4', 'volume_name': 'volume-445a2632-2bc6-41c7-b725-6966750bb5c4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a2b22c-777d-4ccc-9a08-991850a42f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a2b22c-777d-4ccc-9a08-991850a42f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175af3c0-50f9-4bb9-b6c9-fd12bedf74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:42 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Volume 445a2632-2bc6-41c7-b725-6966750bb5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445a2632-2bc6-41c7-b725-6966750bb5c4', 'volume_size': 1} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344100588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445a2632-2bc6-41c7-b725-6966750bb5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:43Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Creating volume 445a2632-2bc6-41c7-b725-6966750bb5c4 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:44:42 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:44:42 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:42 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 1073741824 Jul 06 12:44:42 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:43 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091" returned: 0 in 0.793s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:43 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5616e13a-28bf-477e-a410-e2fef7763399(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:44:43 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faf32c0-ecbf-40e2-a629-4ca77823b13a]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:43 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 Jul 06 12:44:43 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:43 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 1073741824" returned: 0 in 0.858s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:43 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:43 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 Jul 06 12:44:43 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:44 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399" returned: 0 in 0.759s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:44 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 Jul 06 12:44:44 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:44 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4" returned: 0 in 0.632s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:44 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:44:44 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175af3c0-50f9-4bb9-b6c9-fd12bedf74fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445a2632-2bc6-41c7-b725-6966750bb5c4', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceaba045-1e18-4a5b-9823-52193c08c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:44 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Volume volume-445a2632-2bc6-41c7-b725-6966750bb5c4 (445a2632-2bc6-41c7-b725-6966750bb5c4): created successfully Jul 06 12:44:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceaba045-1e18-4a5b-9823-52193c08c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:44 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (2d5322e0-2165-4d39-8c3d-3fe105a2a962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:44 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-aa3d7dca-a106-4c52-a9a1-a964da5bb5d6 tempest-ProjectMemberTests-1109497705 None] Created volume successfully. Jul 06 12:44:45 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091" returned: 0 in 0.753s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:45 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091 Jul 06 12:44:45 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] Creating offline snapshot 5c578913-5743-41bb-b35d-4d34220dde59 of volume 445a2632-2bc6-41c7-b725-6966750bb5c4 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[5292b732-97d8-4d05-9546-fdf69b2e9d08]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:45 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 Jul 06 12:44:45 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:45 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399.d210820c-7466-47e2-9d8a-32d885677091" returned: 0 in 0.662s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-d210820c-7466-47e2-9d8a-32d885677091" released by "_delete_snapshot" :: held 3.091s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-5616e13a-28bf-477e-a410-e2fef7763399" released by "delete_snapshot" :: held 3.126s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Created reservations ['6c50f78f-81fe-4d62-ac0e-82dac6178f44', '843a9da5-2906-4356-8a0e-333f1d84892f', '42f28566-ccd2-4350-b70b-9f40bdebd26c', '0fe89cda-e8af-48fc-a394-1e9c513e6541'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:44:45 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Delete snapshot completed successfully. Jul 06 12:44:45 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-70e2a82b-8e13-4f48-8322-a2196360e626 tempest-ProjectReaderTests-189174883 None] Lock "cinder-d210820c-7466-47e2-9d8a-32d885677091-delete_snapshot" released by "delete_snapshot" :: held 3.296s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:46 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4" returned: 0 in 0.759s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:46 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 1G Jul 06 12:44:46 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-5616e13a-28bf-477e-a410-e2fef7763399-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Lock "cinder-5616e13a-28bf-477e-a410-e2fef7763399-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Acquiring lock "cinder-quobyte-5616e13a-28bf-477e-a410-e2fef7763399" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:46 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-5616e13a-28bf-477e-a410-e2fef7763399" acquired by "delete_volume" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:46 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 1G" returned: 0 in 0.836s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-445a2632-2bc6-41c7-b725-6966750bb5c4 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:46 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d61266a-84a8-412f-b507-0e3922cc32b0]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:46 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:46 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-445a2632-2bc6-41c7-b725-6966750bb5c4 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 Jul 06 12:44:46 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:47 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 Jul 06 12:44:47 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:47 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-445a2632-2bc6-41c7-b725-6966750bb5c4 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59" returned: 0 in 0.669s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:47 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 is being set with open permissions: ugo+rw Jul 06 12:44:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:47 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 Jul 06 12:44:47 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:47 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399" returned: 0 in 0.745s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:47 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:47 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399 Jul 06 12:44:47 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:48 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59" returned: 0 in 0.637s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:48 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.info Jul 06 12:44:48 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:48 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5616e13a-28bf-477e-a410-e2fef7763399" returned: 0 in 0.642s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Lock "cinder-quobyte-5616e13a-28bf-477e-a410-e2fef7763399" released by "delete_volume" :: held 1.456s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Created reservations ['cc17fa65-c802-482a-8225-d72c5903de2a', '0b378c23-2337-4248-9e3c-0bc348b806cd', 'e049a4d0-57c6-492e-9aa1-200feab88f05', 'd6e70d0f-e9eb-4a13-b69c-778acac11323'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:48 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:44:48 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:48 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.info" returned: 0 in 0.649s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:48 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.info is being set with open permissions: ugo+rw Jul 06 12:44:48 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:48 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.info Jul 06 12:44:48 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:49 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.667s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:49 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:44:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Deleted volume successfully. Jul 06 12:44:49 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-52e28573-ad92-4bc2-8ca3-25439cf3426b tempest-ProjectReaderTests-189174883 None] Lock "cinder-5616e13a-28bf-477e-a410-e2fef7763399-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:49 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.info" returned: 0 in 0.701s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:49 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.341s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:49 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-dfb8229e-1096-4ca6-82a8-30b377834f48 tempest-ProjectMemberTests-1109497705 None] Create snapshot completed successfully Jul 06 12:44:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-5c578913-5743-41bb-b35d-4d34220dde59-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-5c578913-5743-41bb-b35d-4d34220dde59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-445a2632-2bc6-41c7-b725-6966750bb5c4" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-445a2632-2bc6-41c7-b725-6966750bb5c4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-5c578913-5743-41bb-b35d-4d34220dde59" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:50 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-5c578913-5743-41bb-b35d-4d34220dde59" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Deleting offline snapshot 5c578913-5743-41bb-b35d-4d34220dde59 of volume 445a2632-2bc6-41c7-b725-6966750bb5c4 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:44:50 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] snapshot_file for this snap is: volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:44:50 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfacedf9-90bf-4f20-a779-fa598f8d60a4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:50 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:50 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 Jul 06 12:44:50 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:51 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59" returned: 0 in 0.760s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:51 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-445a2632-2bc6-41c7-b725-6966750bb5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:44:51 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df71d2f-8bd1-4010-bd42-55fb75772a8d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:51 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:51 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 Jul 06 12:44:51 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:52 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4" returned: 0 in 0.824s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:52 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:52 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 Jul 06 12:44:52 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:53 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59" returned: 0 in 0.722s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:53 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59 Jul 06 12:44:53 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:53 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:53 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4.5c578913-5743-41bb-b35d-4d34220dde59" returned: 0 in 0.608s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-5c578913-5743-41bb-b35d-4d34220dde59" released by "_delete_snapshot" :: held 3.025s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:53 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-445a2632-2bc6-41c7-b725-6966750bb5c4" released by "delete_snapshot" :: held 3.055s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:53 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Created reservations ['aa98d586-9294-42e5-b8ff-885c67fcdefb', 'fcdc5fb6-dc12-42e9-b192-ec12aab82947', 'd70ac2a8-37df-4717-8b37-3853fc45cd1f', 'de7fa2d0-f351-4c0f-81b5-7ddf7d3bbe26'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:44:54 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Delete snapshot completed successfully. Jul 06 12:44:54 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4a876a9a-85d8-4d3e-a746-f33ffca23bc1 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-5c578913-5743-41bb-b35d-4d34220dde59-delete_snapshot" released by "delete_snapshot" :: held 3.222s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-445a2632-2bc6-41c7-b725-6966750bb5c4-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-445a2632-2bc6-41c7-b725-6966750bb5c4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-445a2632-2bc6-41c7-b725-6966750bb5c4" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:44:55 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-445a2632-2bc6-41c7-b725-6966750bb5c4" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:44:55 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ca30a5-99e1-4a9c-bc38-2f684c13cd47]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:55 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 Jul 06 12:44:55 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:55 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4" returned: 0 in 0.744s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:55 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:55 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4 Jul 06 12:44:55 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:56 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-445a2632-2bc6-41c7-b725-6966750bb5c4" returned: 0 in 0.631s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:56 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-445a2632-2bc6-41c7-b725-6966750bb5c4" released by "delete_volume" :: held 1.431s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:56 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Created reservations ['3dec7e36-ad78-40b5-9e28-314e6525c5c8', '3a7e8ca8-d257-42f5-956f-d25a5dc4c187', '1a6f5a38-40ce-48b7-a80a-e28dc56ed4b2', 'b7c05e69-d313-4433-b712-d43c6ca398c1'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:44:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:56 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:56 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:56 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:44:56 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:57 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.638s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:44:57 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Deleted volume successfully. Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-e325546b-d536-475a-b2ca-7eec73c03ed1 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-445a2632-2bc6-41c7-b725-6966750bb5c4-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (b3f90006-80dc-4298-ba25-3d2357519a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a3f354-414a-458d-a567-996e08e3388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a3f354-414a-458d-a567-996e08e3388a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062556483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea11b8f-f592-4e2d-99b9-a044b2c1b041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:58Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abffd8b-f63a-4a90-b2e3-526bbe706189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abffd8b-f63a-4a90-b2e3-526bbe706189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7affb46-c1d2-4ede-82e9-2ad0e07358e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7affb46-c1d2-4ede-82e9-2ad0e07358e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea11b8f-f592-4e2d-99b9-a044b2c1b041', 'volume_name': 'volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a126d69-92f8-4002-84b1-8c6a2367bb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a126d69-92f8-4002-84b1-8c6a2367bb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693fd7ae-2c45-4b99-b829-00d7c59b263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:57 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Volume 5ea11b8f-f592-4e2d-99b9-a044b2c1b041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041', 'volume_size': 1} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062556483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea11b8f-f592-4e2d-99b9-a044b2c1b041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:44:58Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Creating volume 5ea11b8f-f592-4e2d-99b9-a044b2c1b041 {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:44:57 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:44:57 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:57 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 1073741824 Jul 06 12:44:57 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:58 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 1073741824" returned: 0 in 0.877s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:58 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:44:58 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 Jul 06 12:44:58 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:44:59 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041" returned: 0 in 0.683s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693fd7ae-2c45-4b99-b829-00d7c59b263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf40c15-e115-4c56-a2c5-1255527966e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:44:59 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Volume volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 (5ea11b8f-f592-4e2d-99b9-a044b2c1b041): created successfully Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf40c15-e115-4c56-a2c5-1255527966e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (b3f90006-80dc-4298-ba25-3d2357519a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:44:59 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-27e0bc66-6828-4d13-bf30-f37325c43236 tempest-ProjectMemberTests-1109497705 None] Created volume successfully. Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=75,cinder:UPDATE=77,cinder:DELETE=10,cinder:INSERT=24 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] Creating offline snapshot 35245c46-0c53-4087-9f2f-f423832ffbda of volume 5ea11b8f-f592-4e2d-99b9-a044b2c1b041 {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42edfa3-6bb9-40c8-9735-71749f0d772b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:44:59 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:00 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 Jul 06 12:45:00 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:00 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041" returned: 0 in 0.764s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:00 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:00 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda 1G Jul 06 12:45:00 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:01 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda 1G" returned: 0 in 0.767s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:01 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:01 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda Jul 06 12:45:01 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:02 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda" returned: 0 in 0.663s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:02 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda is being set with open permissions: ugo+rw Jul 06 12:45:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:02 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda Jul 06 12:45:02 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:02 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda" returned: 0 in 0.637s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:02 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:SELECT=72,cinder:UPDATE=110,cinder:INSERT=27,cinder:DELETE=6 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:45:02 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:02 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.info Jul 06 12:45:02 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:03 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.info" returned: 0 in 0.619s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:03 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.info is being set with open permissions: ugo+rw Jul 06 12:45:03 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:03 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.info Jul 06 12:45:03 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:04 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.info" returned: 0 in 0.637s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:04 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.170s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:45:04 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-ec0cc69c-4c90-4c91-bdf1-93bcc098357c tempest-ProjectMemberTests-1109497705 None] Create snapshot completed successfully Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-35245c46-0c53-4087-9f2f-f423832ffbda-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Lock "cinder-35245c46-0c53-4087-9f2f-f423832ffbda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-5ea11b8f-f592-4e2d-99b9-a044b2c1b041" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-5ea11b8f-f592-4e2d-99b9-a044b2c1b041" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-35245c46-0c53-4087-9f2f-f423832ffbda" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-35245c46-0c53-4087-9f2f-f423832ffbda" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Deleting offline snapshot 35245c46-0c53-4087-9f2f-f423832ffbda of volume 5ea11b8f-f592-4e2d-99b9-a044b2c1b041 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] snapshot_file for this snap is: volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[80628f13-c494-466a-b03e-cbe6e733694e]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:05 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda Jul 06 12:45:05 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:05 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda" returned: 0 in 0.718s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab16cba8-9e47-4144-9fd2-1b31686f7a6b]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:45:05 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:06 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 Jul 06 12:45:06 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:06 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041" returned: 0 in 0.730s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:06 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:06 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda Jul 06 12:45:06 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:07 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda" returned: 0 in 0.714s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:07 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:07 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda Jul 06 12:45:07 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:08 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041.35245c46-0c53-4087-9f2f-f423832ffbda" returned: 0 in 0.652s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-35245c46-0c53-4087-9f2f-f423832ffbda" released by "_delete_snapshot" :: held 2.899s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-5ea11b8f-f592-4e2d-99b9-a044b2c1b041" released by "delete_snapshot" :: held 2.922s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:08 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Created reservations ['5c931c9b-9fcd-44c8-bcfa-a302e050e1e4', 'd4d9fee9-cc31-4c00-805a-73be9a68f26a', '888c8aea-f745-476b-bce5-470ca6adfdf0', 'bdd368b8-55e2-4416-a679-8d2331a1e7b8'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:45:08 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Delete snapshot completed successfully. Jul 06 12:45:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-4c2421ed-3887-4808-9485-4cec6fe629da tempest-ProjectMemberTests-1109497705 None] Lock "cinder-35245c46-0c53-4087-9f2f-f423832ffbda-delete_snapshot" released by "delete_snapshot" :: held 3.053s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-5ea11b8f-f592-4e2d-99b9-a044b2c1b041-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-5ea11b8f-f592-4e2d-99b9-a044b2c1b041-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-5ea11b8f-f592-4e2d-99b9-a044b2c1b041" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:08 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-5ea11b8f-f592-4e2d-99b9-a044b2c1b041" acquired by "delete_volume" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:08 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99f0c33-9a5f-4f56-a738-e675acd27625]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:45:08 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:08 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 Jul 06 12:45:08 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:09 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041" returned: 0 in 0.730s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:09 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041 Jul 06 12:45:09 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:09 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-5ea11b8f-f592-4e2d-99b9-a044b2c1b041" returned: 0 in 0.657s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:09 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-5ea11b8f-f592-4e2d-99b9-a044b2c1b041" released by "delete_volume" :: held 1.439s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:09 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Created reservations ['4c6c38c3-3fd7-403a-8b61-489cc8300921', '05c73f05-ae80-4062-bb97-fe893e6faefc', 'b0024f4f-740f-4366-a5c3-7eb89588f14b', '1e890f17-80d5-4a9a-96a4-3eb5fc7bb978'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:45:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:45:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:45:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:45:09 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:45:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:45:09 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:09 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:45:09 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:10 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:10 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.665s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:10 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:45:10 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Deleted volume successfully. Jul 06 12:45:10 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b0965772-3d7f-4bd6-9ba1-41867af669a6 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-5ea11b8f-f592-4e2d-99b9-a044b2c1b041-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:10 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (005c8b01-cf47-4095-a19b-5bdca4dcf97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d5c5a6-55a0-4a8c-ac5a-77fa84edbf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d5c5a6-55a0-4a8c-ac5a-77fa84edbf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067777022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f0533c-df17-481c-9080-887d7b54656b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:45:11Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d725e8-5c81-4116-91e3-828c1a677fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d725e8-5c81-4116-91e3-828c1a677fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0626fd-3efb-4f02-8794-814781080604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0626fd-3efb-4f02-8794-814781080604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f0533c-df17-481c-9080-887d7b54656b', 'volume_name': 'volume-d2f0533c-df17-481c-9080-887d7b54656b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0649c0e8-e04d-4333-965d-af4ef3b70cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0649c0e8-e04d-4333-965d-af4ef3b70cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7761280-9e1c-48a1-b993-d46f2e0c6f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:11 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Volume d2f0533c-df17-481c-9080-887d7b54656b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f0533c-df17-481c-9080-887d7b54656b', 'volume_size': 1} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067777022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f0533c-df17-481c-9080-887d7b54656b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:45:11Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Creating volume d2f0533c-df17-481c-9080-887d7b54656b {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:45:11 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:11 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b 1073741824 Jul 06 12:45:11 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:11 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:11 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b 1073741824" returned: 0 in 0.853s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:12 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b Jul 06 12:45:12 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:12 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b" returned: 0 in 0.614s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:12 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:45:12 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:45:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7761280-9e1c-48a1-b993-d46f2e0c6f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f0533c-df17-481c-9080-887d7b54656b', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dbbfe0-7f1b-45fe-b18b-8b6249ba133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:12 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Volume volume-d2f0533c-df17-481c-9080-887d7b54656b (d2f0533c-df17-481c-9080-887d7b54656b): created successfully Jul 06 12:45:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dbbfe0-7f1b-45fe-b18b-8b6249ba133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:12 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (005c8b01-cf47-4095-a19b-5bdca4dcf97a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:45:12 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5dec4cfa-f18d-4d8f-b495-6a26cb9a53b4 tempest-ProjectMemberTests-1109497705 None] Created volume successfully. Jul 06 12:45:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:45:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:45:13 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] Creating offline snapshot 7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 of volume d2f0533c-df17-481c-9080-887d7b54656b {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:45:13 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb478c2a-1281-4a9e-929d-d1467bae6ab6]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:45:13 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:13 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b Jul 06 12:45:13 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:14 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b" returned: 0 in 0.710s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:14 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:14 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 1G Jul 06 12:45:14 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:15 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 1G" returned: 0 in 0.785s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f0533c-df17-481c-9080-887d7b54656b -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:15 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f0533c-df17-481c-9080-887d7b54656b -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 Jul 06 12:45:15 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:15 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f0533c-df17-481c-9080-887d7b54656b -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4" returned: 0 in 0.644s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:15 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 is being set with open permissions: ugo+rw Jul 06 12:45:15 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:15 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 Jul 06 12:45:15 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:16 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4" returned: 0 in 0.597s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:16 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.info Jul 06 12:45:16 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:16 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.info" returned: 0 in 0.607s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:16 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.info is being set with open permissions: ugo+rw Jul 06 12:45:16 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:16 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.info Jul 06 12:45:16 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:17 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.info" returned: 0 in 0.627s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:17 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.043s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:45:17 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-1f2c1e8d-5de3-4239-b89b-05d8f8c7fb9c tempest-ProjectMemberTests-1109497705 None] Create snapshot completed successfully Jul 06 12:45:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-d2f0533c-df17-481c-9080-887d7b54656b" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-d2f0533c-df17-481c-9080-887d7b54656b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:18 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Deleting offline snapshot 7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 of volume d2f0533c-df17-481c-9080-887d7b54656b {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:45:18 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] snapshot_file for this snap is: volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:45:18 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c589590-6058-4c8c-a255-51c20afeeebc]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:45:18 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:18 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 Jul 06 12:45:18 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:19 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4" returned: 0 in 0.783s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:19 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2f0533c-df17-481c-9080-887d7b54656b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:45:19 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[bade0f2d-3a49-4fe8-8ce2-41074f8113a4]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:45:19 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:19 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b Jul 06 12:45:19 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:20 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b" returned: 0 in 0.909s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:20 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:20 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 Jul 06 12:45:20 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:21 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4" returned: 0 in 0.862s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:21 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4 Jul 06 12:45:21 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:21 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:21 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b.7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4" returned: 0 in 0.612s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4" released by "_delete_snapshot" :: held 3.265s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:21 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-d2f0533c-df17-481c-9080-887d7b54656b" released by "delete_snapshot" :: held 3.288s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:22 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Created reservations ['a8c064ae-b8c2-4ba6-bda7-97b3f4a5e207', '931478ee-5f79-451c-83a6-758c874f1a4b', '748dbe6f-cf20-4f1e-ac2e-9e102ca2deb1', 'a816b0ca-44db-42bf-a224-15dc167f46cc'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:45:22 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Delete snapshot completed successfully. Jul 06 12:45:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-c8fb5cbe-7af8-4bbf-8397-89e0eb9ffa71 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-7ea826c9-ca9c-4a7e-9d0f-fd6da98838f4-delete_snapshot" released by "delete_snapshot" :: held 3.425s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-d2f0533c-df17-481c-9080-887d7b54656b-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-d2f0533c-df17-481c-9080-887d7b54656b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-d2f0533c-df17-481c-9080-887d7b54656b" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:22 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-d2f0533c-df17-481c-9080-887d7b54656b" acquired by "delete_volume" :: waited 0.016s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:23 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564febf-3d8a-4ebb-84f0-9aed8c2f29df]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:45:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:23 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b Jul 06 12:45:23 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:23 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b" returned: 0 in 0.727s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:23 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:23 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b Jul 06 12:45:23 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:24 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-d2f0533c-df17-481c-9080-887d7b54656b" returned: 0 in 0.630s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:24 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-d2f0533c-df17-481c-9080-887d7b54656b" released by "delete_volume" :: held 1.415s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:24 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Created reservations ['1e6c57a2-e9f8-4fad-9bfa-d55973ff4e96', 'ef07ef85-104d-43ba-8873-8db00f5f9208', '3b1471c1-df4a-4c5d-aef4-0ad446f36934', '0e1f9005-07d4-4940-9467-c3ce4f627726'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:45:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:45:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:45:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:45:24 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:45:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:45:24 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:24 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:45:24 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:25 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.641s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:45:25 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Deleted volume successfully. Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-0af7b2a7-0850-4018-9316-9c497e9fed12 tempest-ProjectMemberTests-1109497705 None] Lock "cinder-d2f0533c-df17-481c-9080-887d7b54656b-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.flows.manager.create_volume [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86561) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (c386a0aa-ea04-4c24-ac31-544544f19238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98a26b6-3174-4772-bfde-44be80306b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98a26b6-3174-4772-bfde-44be80306b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804724706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:45:26Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e937d9a1-1634-482f-afd5-468dd35a022d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e937d9a1-1634-482f-afd5-468dd35a022d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5d6778-cd47-4d59-9b3c-91419f0b360e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5d6778-cd47-4d59-9b3c-91419f0b360e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec', 'volume_name': 'volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ae30a1-5fa9-4524-b83f-b6045a19dabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ae30a1-5fa9-4524-b83f-b6045a19dabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ede5823-98a6-47d2-a603-1d6ffb16d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:25 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Volume 3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec', 'volume_size': 1} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T10:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804724706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc08672f9bb4102a449d68ada2f0588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T10:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T10:45:26Z,use_quota=True,user_id='c5d0e78a6aff4ee887a64015eaed3235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eab261b-5824-4b29-8895-5d5a7ef98956),volume_type_id=6eab261b-5824-4b29-8895-5d5a7ef98956)}" {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Creating volume 3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec {{(pid=86561) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Selected osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 as target Quobyte volume. {{(pid=86561) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 12:45:25 devstack cinder-volume[86561]: INFO cinder.volume.drivers.remotefs [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] casted to osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131 Jul 06 12:45:25 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec 1073741824 {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:25 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec 1073741824 Jul 06 12:45:25 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:26 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec 1073741824" returned: 0 in 0.787s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:26 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:26 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec Jul 06 12:45:26 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:27 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec" returned: 0 in 0.622s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'} {{(pid=86561) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ede5823-98a6-47d2-a603-1d6ffb16d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec', 'volume_size': 1}' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f5bf1a-fa45-4857-9b45-a9aa12658df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 12:45:27 devstack cinder-volume[86561]: INFO cinder.volume.flows.manager.create_volume [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Volume volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec (3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec): created successfully Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f5bf1a-fa45-4857-9b45-a9aa12658df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86561) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Flow 'volume_create_manager' (c386a0aa-ea04-4c24-ac31-544544f19238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86561) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 12:45:27 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-5135f6f8-e699-4f2b-ad0a-af9689fe6a8a tempest-ProjectMemberTests-1109497705 None] Created volume successfully. Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] Creating offline snapshot 762865eb-a53f-4e1b-86b8-f39d3f243b9f of volume 3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec {{(pid=86561) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f595611-4fa1-4f13-b67c-52e2372c9481]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:45:27 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:27 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec Jul 06 12:45:27 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:28 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec" returned: 0 in 0.709s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:28 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f 1G {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:28 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f 1G Jul 06 12:45:28 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:29 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f 1G" returned: 0 in 0.753s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:29 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f Jul 06 12:45:29 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:29 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec -F qcow2 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f" returned: 0 in 0.718s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:29 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f is being set with open permissions: ugo+rw Jul 06 12:45:29 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:29 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f Jul 06 12:45:29 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:30 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f" returned: 0 in 0.690s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:30 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:30 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.info Jul 06 12:45:30 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:31 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.info" returned: 0 in 0.640s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:31 devstack cinder-volume[86561]: WARNING cinder.volume.drivers.remotefs [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.info is being set with open permissions: ugo+rw Jul 06 12:45:31 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.info {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:31 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.info Jul 06 12:45:31 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:32 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.info" returned: 0 in 0.694s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.280s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:45:32 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-479056dc-748a-4011-83a0-0c76de83a81c tempest-ProjectMemberTests-1109497705 None] Create snapshot completed successfully Jul 06 12:45:32 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:45:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:45:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:45:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:45:32 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:45:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:45:32 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:32 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:45:32 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-762865eb-a53f-4e1b-86b8-f39d3f243b9f-delete_snapshot" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Lock "cinder-762865eb-a53f-4e1b-86b8-f39d3f243b9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec" by "delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-762865eb-a53f-4e1b-86b8-f39d3f243b9f" by "_delete_snapshot" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-762865eb-a53f-4e1b-86b8-f39d3f243b9f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Deleting offline snapshot 762865eb-a53f-4e1b-86b8-f39d3f243b9f of volume 3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] snapshot_file for this snap is: volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f {{(pid=86561) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51b0309-25a8-41db-ace6-1d037714abc0]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:33 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f Jul 06 12:45:33 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:33 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.657s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG oslo_service.periodic_task [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] Running periodic task VolumeManager._thread_info {{(pid=86561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread count: 29 {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.volume.manager [None req-165f2cc8-1e9c-46b6-addc-6b5de95e0937 None None] thread info: [<_MainThread(MainThread, started 131765016256640)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 12:45:33 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f" returned: 0 in 0.736s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.remotefs [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86561) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[8beef303-e1bc-418f-aa20-4b799598658d]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:45:33 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:34 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec Jul 06 12:45:34 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:34 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec" returned: 0 in 0.728s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:34 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:34 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f Jul 06 12:45:34 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:35 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f" returned: 0 in 0.703s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:35 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:35 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f Jul 06 12:45:35 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:36 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec.762865eb-a53f-4e1b-86b8-f39d3f243b9f" returned: 0 in 0.689s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-762865eb-a53f-4e1b-86b8-f39d3f243b9f" released by "_delete_snapshot" :: held 2.945s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec" released by "delete_snapshot" :: held 2.967s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:36 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Created reservations ['5eb43e53-4bd5-4587-b875-33932823a2e0', '49304a1d-be96-4ffb-9c8f-ea2164ec05ed', '7fec5ecb-b4b2-453b-b3f4-a71a381e1179', '3c699327-2205-4369-b2d6-a2c49bcccf07'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:45:36 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Delete snapshot completed successfully. Jul 06 12:45:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-b03e5213-4cad-4695-a2fd-0890d9e5236d tempest-ProjectMemberTests-1109497705 None] Lock "cinder-762865eb-a53f-4e1b-86b8-f39d3f243b9f-delete_snapshot" released by "delete_snapshot" :: held 3.098s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec-delete_volume" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Lock "cinder-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Acquiring lock "cinder-quobyte-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec" by "delete_volume" {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 12:45:36 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec" acquired by "delete_volume" :: waited 0.014s {{(pid=86561) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 12:45:36 devstack cinder-volume[86561]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ff5878-0d7c-4e14-8324-16a1f615f173]: (4, 'qcow2') {{(pid=87828) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 12:45:36 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:36 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec Jul 06 12:45:36 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:37 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec" returned: 0 in 0.736s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:37 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec Jul 06 12:45:37 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:37 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d/volume-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec" returned: 0 in 0.658s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:37 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Lock "cinder-quobyte-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec" released by "delete_volume" :: held 1.448s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:37 devstack cinder-volume[86561]: DEBUG cinder.quota [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Created reservations ['5695cbba-643f-4c7f-aec7-7d85456597bd', '5063bbc9-0f5d-4877-bc70-d22831cb47bc', '5e683760-8c8d-42ea-b64d-88a65c698e40', '93eb8a94-5b9a-439d-8f05-8deb20649679'] {{(pid=86561) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 12:45:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 12:45:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 12:45:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131': None} {{(pid=86561) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 12:45:37 devstack cinder-volume[86561]: DEBUG cinder.volume.drivers.quobyte [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7227c971-30f4-4e57-91a9-0288c43b8131'] {{(pid=86561) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 12:45:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.lockutils [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86561) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 12:45:37 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 12:45:37 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d Jul 06 12:45:37 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 12:45:38 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Jul 06 12:45:38 devstack cinder-volume[86561]: DEBUG oslo_concurrency.processutils [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0faa7e51d6bc577f682a8c7f8919079d" returned: 0 in 0.637s {{(pid=86561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 12:45:38 devstack cinder-volume[86561]: DEBUG cinder.manager [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Notifying Schedulers of capabilities ... {{(pid=86561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 12:45:38 devstack cinder-volume[86561]: INFO cinder.volume.manager [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Deleted volume successfully. Jul 06 12:45:38 devstack cinder-volume[86561]: DEBUG cinder.coordination [None req-f95fa8c9-0acb-4c6f-a580-caecdc45bd5c tempest-ProjectMemberTests-1109497705 None] Lock "cinder-3b78d50d-d710-4bac-a1dc-e30d8c5ad4ec-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86561) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 12:45:47 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=52,cinder:SELECT=43,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 12:45:48 devstack cinder-volume[86561]: DEBUG dbcounter [-] [86561] Writing DB stats cinder:UPDATE=50,cinder:SELECT=35,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}